-- Logs begin at Fri 2021-11-19 14:26:21 UTC, end at Fri 2021-11-19 15:25:29 UTC. -- Nov 19 14:55:52.360466 dv-cinder-817573-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 14:55:52.369400 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 14:55:52 2021] *** Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: nodename: dv-cinder-817573-1-iscsi Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: machine: x86_64 Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: clock source: unix Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: pcre jit disabled Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: detected number of CPU cores: 4 Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: current working directory: / Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: detected binary path: /usr/bin/uwsgi-core Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: your processes number limit is 47680 Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: your memory page size is 4096 bytes Nov 19 14:55:52.371972 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: detected max file descriptor number: 2048 Nov 19 14:55:52.373706 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: lock engine: pthread robust mutexes Nov 19 14:55:52.373706 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: thunder lock: enabled Nov 19 14:55:52.373706 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 14:55:52.373706 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 14:55:52.417028 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: Python main interpreter initialized at 0x561e3ea099c0 Nov 19 14:55:52.417028 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: python threads support enabled Nov 19 14:55:52.417028 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: your server socket listen backlog is limited to 100 connections Nov 19 14:55:52.417028 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: your mercy for graceful operations on workers is 90 seconds Nov 19 14:55:52.417394 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 14:55:52.417471 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: *** Operational MODE: preforking *** Nov 19 14:55:52.417692 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: *** uWSGI is running in multiple interpreter mode *** Nov 19 14:55:52.417692 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: spawned uWSGI master process (pid: 102046) Nov 19 14:55:52.417881 dv-cinder-817573-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 14:55:52.418651 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: spawned uWSGI worker 1 (pid: 102047, cores: 1) Nov 19 14:55:52.418756 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: spawned uWSGI worker 2 (pid: 102048, cores: 1) Nov 19 14:55:52.420708 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 14:55:54.014300 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 14:55:54.014300 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: from cryptography.utils import int_from_bytes Nov 19 14:55:54.014908 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 14:55:54.014908 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: from cryptography.utils import int_from_bytes Nov 19 14:55:54.017905 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 14:55:54.017905 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: from cryptography.utils import int_from_bytes Nov 19 14:55:54.018398 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 14:55:54.018398 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: from cryptography.utils import int_from_bytes Nov 19 14:55:56.497708 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 14:55:56.498271 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 14:55:56.498440 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 14:55:56.498805 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 14:55:56.499062 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 14:55:56.499450 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.499780 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.500102 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.500424 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.500754 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.501064 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 14:55:56.501456 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.501542 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 14:55:56.501630 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.501721 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.501808 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 14:55:56.502027 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.502161 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 14:55:56.502287 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.502421 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 14:55:56.502604 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.502823 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.502916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817573-1-iscsi {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503151 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503238 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503480 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503569 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503803 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.503889 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504136 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504227 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504442 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504536 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504764 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.504916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.505105 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.505201 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.505433 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.505605 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.505709 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.506723 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.506866 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.506988 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817573-1-iscsi {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507077 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507157 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507283 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507374 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507464 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507545 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507629 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507708 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507870 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.507999 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508098 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508187 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508267 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508443 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508568 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508806 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.508984 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509217 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817573-1-iscsi {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509317 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509541 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509630 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509860 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.509967 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510177 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510263 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510528 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510621 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510843 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.510953 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511169 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511272 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511482 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511576 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511802 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.511883 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512114 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512218 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512437 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512536 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817573-1-iscsi {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512758 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.512877 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.513626 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.513730 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.513954 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514064 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514259 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514411 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514573 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514728 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.514884 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515045 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515205 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515370 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515512 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515696 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.515819 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516009 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516096 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516339 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516426 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516660 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.516762 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517009 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517096 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517333 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517420 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517589 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517687 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517840 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.517928 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518158 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518251 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518480 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518614 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518791 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.518878 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519101 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519238 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519369 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519464 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519683 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519779 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.519999 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520095 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520306 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520394 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520615 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520707 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520891 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.520992 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521148 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521246 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521471 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521559 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521798 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.521895 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522112 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522208 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522425 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522512 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522738 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.522858 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523048 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523134 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523357 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523443 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523675 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523768 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.523987 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524072 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524298 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524397 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524620 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524708 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.524965 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525055 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525276 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525362 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525586 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525674 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525896 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.525989 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526217 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526303 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526536 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526628 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526842 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.526927 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527093 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527178 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527395 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527482 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527703 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.527790 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.528021 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.528115 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.528328 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.528421 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529368 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529474 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529555 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529766 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529859 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.529939 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530144 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530250 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530451 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530548 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530760 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.530846 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531044 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531130 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531351 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531455 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531653 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531745 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.531961 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532048 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532267 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532355 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532572 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532657 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.532916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533020 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533223 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533311 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533534 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533619 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533840 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.533934 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534148 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534236 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534454 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534549 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534762 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.534854 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535072 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535158 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535377 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535469 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535686 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535770 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.535990 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536078 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536301 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536431 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536618 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536727 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.536948 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537038 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537254 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537340 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537563 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537657 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537859 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.537945 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538254 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538477 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538562 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538786 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.538931 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539090 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539228 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539395 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539550 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539699 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.539786 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540002 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540088 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540310 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540419 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540611 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540697 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.540938 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541030 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541239 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541387 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541547 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541632 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541852 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.541944 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542159 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542255 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542464 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542550 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542766 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.542851 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.543071 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.543157 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.543378 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.543465 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.543693 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.543780 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.543998 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.544085 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.544401 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.544641 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.544724 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.544817 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.545059 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.545192 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.545373 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.545459 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.545686 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.545780 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.545999 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.546087 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.546310 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.546395 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.546632 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 14:55:56.546732 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.546967 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547062 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547278 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547362 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547600 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547694 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.547921 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548007 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548251 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548345 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548569 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548668 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.548910 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549013 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549226 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549317 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549537 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549624 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549857 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.549943 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550170 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550275 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550486 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550586 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550797 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.550883 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551116 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551201 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551436 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551531 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551762 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.551847 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552079 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552163 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552391 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552477 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552712 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.552811 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553052 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553141 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553363 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553450 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553678 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.553765 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554011 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554097 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554323 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554409 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554643 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554730 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.554979 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555067 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555295 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555382 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555608 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555701 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.555916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556012 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556221 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556318 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556526 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556619 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556858 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.556963 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557255 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557485 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557572 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557811 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.557974 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558119 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558229 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558450 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558537 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558756 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.558851 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559067 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559154 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559375 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559461 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559678 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.559764 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560008 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560098 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560324 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560585 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560710 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.560939 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561036 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561274 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561368 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561583 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561678 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561893 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.561979 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562216 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562301 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562525 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562631 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562837 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.562930 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563144 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563236 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563459 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563553 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563774 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.563859 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564085 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564172 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564413 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564522 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564727 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.564869 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565063 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565160 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565390 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565479 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565699 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.565787 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566009 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566095 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566329 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566417 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566644 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566732 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.566959 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567054 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567268 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567354 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567582 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567668 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567888 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.567984 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568196 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568283 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568501 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568596 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568834 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.568937 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569146 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569232 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569452 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569540 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569757 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.569852 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570060 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570158 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570363 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570449 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570685 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570773 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.570993 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571079 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571294 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571383 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571598 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571685 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571902 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.571996 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572208 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572293 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572516 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572604 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572843 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.572944 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573155 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573243 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573468 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573556 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573793 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.573880 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574104 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574203 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574412 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574499 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574719 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.574805 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.575025 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.575126 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.575337 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.575423 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.576183 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.576325 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.576764 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.576929 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.576929 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577152 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577236 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577322 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577492 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577589 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577811 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.577897 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578131 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578225 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578446 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578534 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578760 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.578845 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579073 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579159 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579390 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579486 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579711 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.579797 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580026 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580127 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580348 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580436 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580660 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.580817 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581003 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581091 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581315 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581409 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581627 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581712 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.581938 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582031 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582248 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582341 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582570 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582664 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582884 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.582983 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583204 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583298 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583517 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583604 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583834 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.583927 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584142 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584228 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584454 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584546 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584758 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.584875 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585094 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585180 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585409 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585497 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585731 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.585826 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586042 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586128 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586357 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586444 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586669 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586765 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.586981 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587066 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587293 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587386 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587605 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587695 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587909 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.587995 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588214 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588300 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588528 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588616 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588874 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.588976 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589190 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589276 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589502 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589596 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589808 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.589894 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590120 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590218 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590426 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590512 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590732 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.590855 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.591041 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.591203 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.591898 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592004 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592270 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592368 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592614 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592727 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.592956 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593055 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593272 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593373 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593583 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593691 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593893 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.593993 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594204 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594299 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594513 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594623 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594822 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.594928 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595127 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595222 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595435 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595533 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595750 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.595845 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.596075 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.596172 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.596377 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.596472 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.596983 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597081 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597294 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597403 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597604 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597706 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.597917 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598014 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598224 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598320 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598533 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598657 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598837 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.598933 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599156 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599265 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599467 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599564 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599777 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.599879 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600084 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600202 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600395 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600491 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600705 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.600833 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601044 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601150 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601352 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601437 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601661 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601753 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.601971 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602096 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602275 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602374 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602585 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602682 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602896 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.602992 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.603212 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.603460 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.603563 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.603794 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.603900 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604112 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604208 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604433 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604530 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604743 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.604870 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605091 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605186 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605422 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605510 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605733 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.605831 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.606052 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.606138 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.606360 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.606613 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.606710 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607029 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607153 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607339 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607654 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607747 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.607960 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608049 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608269 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608357 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608574 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608661 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.608908 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609004 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609233 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609321 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609525 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609688 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.609861 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610001 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610165 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610317 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610466 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610618 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610751 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.610895 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611067 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611198 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611366 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611502 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611672 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611808 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.611996 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612172 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612286 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612373 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612590 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612684 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.612920 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613011 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613256 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613344 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613557 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613645 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613877 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.613972 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614185 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614273 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614500 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614596 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614807 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.614895 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615131 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615217 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615442 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615536 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615745 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.615838 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616051 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616138 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616354 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616449 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616664 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.616752 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617000 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617089 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617304 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617393 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617616 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617704 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.617925 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618013 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618239 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618335 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618549 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618637 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618853 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.618947 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619163 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619252 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619468 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619555 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619773 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.619872 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620078 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620164 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620383 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620484 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620683 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.620784 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621019 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621120 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621327 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621424 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621627 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621725 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.621937 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622026 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622241 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622329 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622618 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622722 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.622928 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623075 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623233 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623396 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623536 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623711 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.623848 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624025 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624158 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624334 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624462 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624650 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624822 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.624989 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625127 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625298 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625433 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625612 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625737 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.625918 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626049 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626239 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626356 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626548 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626661 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626856 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.626972 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627162 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627297 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627475 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627612 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627787 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.627915 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628092 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628226 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628419 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628531 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628737 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.628868 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629070 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629160 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629380 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629477 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629697 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.629840 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630009 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630125 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630317 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630416 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630628 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630725 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.630932 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631029 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631255 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631351 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631562 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631671 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631864 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.631958 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632168 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632283 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632472 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632580 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632777 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.632893 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633111 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633199 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633420 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633518 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633726 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.633821 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634039 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634128 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634346 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634443 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634652 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634740 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.634968 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635061 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635283 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635377 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635584 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635670 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635891 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.635982 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636200 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636295 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636515 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636611 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636842 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.636947 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637151 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637246 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637473 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637561 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637788 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.637882 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.638645 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.638762 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.638964 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.639180 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.639268 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.639513 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.639601 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.639845 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640009 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640163 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640304 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640450 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640669 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640852 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.640988 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641124 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641282 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641449 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641584 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641674 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641755 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.641980 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642072 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642298 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642402 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642615 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642723 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.642929 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643031 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643245 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643340 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643549 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643643 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643860 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.643959 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644173 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644261 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644483 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644626 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644817 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.644925 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645126 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645226 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645436 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645523 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645750 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.645846 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646059 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646146 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646372 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646458 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646677 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646766 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.646983 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647101 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647296 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647417 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647612 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647731 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.647922 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648039 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648252 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648338 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648568 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648656 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648903 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.648994 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649220 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649320 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649528 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649616 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649843 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.649992 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.650143 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.650292 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.650564 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.650720 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.650882 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651014 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651188 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651347 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651496 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651659 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651793 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.651938 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652098 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652241 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652402 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652546 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652768 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.652936 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.653073 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.653220 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.653367 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.653508 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.653666 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.654397 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.654611 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.654761 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.654895 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655031 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655324 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655470 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655638 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.655882 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656027 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656199 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656349 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656514 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656652 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.656859 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657001 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657182 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657318 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657505 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657641 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657811 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.657958 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658127 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658298 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658441 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658530 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658766 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.658854 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659089 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659189 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659402 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659543 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659717 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.659864 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660021 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660185 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660344 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660511 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660666 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.660860 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661010 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661193 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661333 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661506 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661747 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.661846 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662070 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662159 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662383 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662469 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662703 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.662789 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663032 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663137 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663339 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663426 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663644 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663730 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.663957 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664054 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664263 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664352 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664570 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664656 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.664916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665006 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665226 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665316 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665542 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665630 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665855 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.665953 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666255 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666471 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666557 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666775 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.666875 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667099 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667193 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667406 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667492 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667731 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.667828 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668046 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668133 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668370 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668462 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668683 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.668782 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669014 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669100 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669397 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669503 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669709 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.669808 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670018 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670107 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670327 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670435 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670633 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670722 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.670977 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671064 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671286 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671380 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671609 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671698 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.671941 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672030 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672269 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672356 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672578 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672666 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.672927 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673017 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673245 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673331 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673556 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673645 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673865 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.673952 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674175 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674271 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674483 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674569 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674788 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.674875 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675102 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675198 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675414 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675502 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675719 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.675805 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676024 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676127 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676334 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676421 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676639 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676726 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.676977 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677077 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677286 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677373 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677610 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677703 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.677915 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678004 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678236 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678330 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678549 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678634 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678854 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.678942 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679160 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679246 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679465 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679550 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679776 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.679870 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680083 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680169 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680394 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680514 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680702 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.680839 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681054 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681152 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681364 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681632 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681744 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681856 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.681990 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682107 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682295 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682391 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682604 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682692 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.682914 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683001 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683230 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683376 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683546 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683684 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.683863 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684000 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684180 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684330 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684490 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684628 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684822 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.684953 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.685206 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.685296 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.685531 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.685618 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.685899 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686051 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686223 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686382 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686544 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686699 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.686865 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687014 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687187 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687330 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687507 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687645 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687826 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.687959 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688142 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688272 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688462 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688584 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688782 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.688962 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689124 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689236 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689565 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689677 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689888 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.689985 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690213 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690302 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690550 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690650 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690866 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.690963 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691181 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691274 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691496 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691584 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691809 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.691911 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692127 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692227 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692439 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692526 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692754 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.692893 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693093 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693239 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693412 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693509 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693731 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.693826 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694046 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694134 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694360 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694457 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694676 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694763 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.694992 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695078 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695308 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695403 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695618 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695706 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.695932 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696020 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696249 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696342 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696571 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696671 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.696913 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697005 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697235 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697325 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697548 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697646 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697862 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.697960 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.698182 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.698300 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.698499 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.698698 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.698797 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699017 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699115 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699351 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699457 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699679 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.699777 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.700003 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.700102 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.700323 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.700421 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.701194 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.701448 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.701552 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.701637 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.701957 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702068 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702264 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702370 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702578 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702790 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.702888 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703112 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703233 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703451 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703554 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703781 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.703879 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704086 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704191 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704408 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704506 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704721 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.704838 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705077 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705283 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705383 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705641 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705738 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.705963 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706052 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706285 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706385 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706591 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706680 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.706917 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707004 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707229 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707319 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707535 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707622 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707854 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.707941 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.708165 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.708261 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.708482 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.708697 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.708805 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709076 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709178 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709400 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709489 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709713 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.709800 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710027 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710128 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710335 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710424 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710650 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710739 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.710958 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711048 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711276 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711364 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711581 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711674 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711890 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.711980 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712196 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712329 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712504 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712592 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712824 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.712917 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713135 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713226 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713452 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713598 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713748 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.713837 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714058 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714151 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714360 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714461 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714671 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714761 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.714977 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715066 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715284 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715391 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715592 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715680 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715902 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.715992 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.716772 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717013 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717129 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717353 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717451 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717665 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717764 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.717975 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718063 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718295 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718385 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718611 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718710 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.718922 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719011 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719237 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719332 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719544 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719640 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.719906 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720006 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720167 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720258 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720494 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720710 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.720855 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.721120 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.721210 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.721441 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.721810 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722023 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722113 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722351 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722440 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722668 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722765 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.722973 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723060 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723285 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723382 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723611 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723709 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.723926 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724148 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724242 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724537 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724625 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724871 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.724983 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725188 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725282 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725501 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725599 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725812 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.725902 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726127 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726217 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726439 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726542 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726756 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.726846 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727070 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727388 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727561 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727704 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.727801 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728020 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728118 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728336 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728426 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728645 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728740 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.728982 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729087 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729293 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729381 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729604 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729695 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.729922 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730015 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730250 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730340 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730564 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730665 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730872 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.730982 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.731192 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.731292 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.731514 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.731621 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.731899 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732160 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732248 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732337 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732505 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732591 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732845 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.732952 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733168 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733265 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733479 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733574 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733802 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.733892 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734116 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734211 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734442 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734529 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734781 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.734871 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735111 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735250 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735437 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735527 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735744 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.735853 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736055 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736145 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736361 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736450 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736676 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.736841 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737030 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737168 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737349 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737451 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737666 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737762 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.737993 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738082 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738305 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738408 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738629 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738717 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.738939 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.739028 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.739251 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.739338 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.741958 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742118 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742236 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742347 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742347 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742576 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742686 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742802 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.742921 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743029 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743155 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743266 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743379 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743501 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743610 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.743719 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744347 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744436 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744584 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744714 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744818 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.744918 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745003 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745083 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745164 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745244 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745379 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745471 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745564 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745656 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745744 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745827 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.745999 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746091 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746179 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746261 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746341 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746431 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746514 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746595 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746675 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746754 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746843 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.746925 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747005 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747092 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747173 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747294 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747578 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747677 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747791 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747883 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.747965 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748045 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748136 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748218 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748299 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748483 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748573 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748850 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.748959 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749166 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749257 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749496 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749593 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749811 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.749901 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.750126 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.750215 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.750433 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.750533 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.750678 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 14:55:56.750776 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.751088 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.751421 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.751773 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.752096 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.752446 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.752778 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.753119 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.753438 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.753749 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 14:55:56.755942 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 14:55:56.773501 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_db.sqlalchemy.engines [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:56.776211 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_db.sqlalchemy.engines [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:56.842002 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.context [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6acf99c9-426c-44c7-b4c6-6e0a659ed6aa(cell1) {{(pid=102047) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 14:55:56.844447 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.context [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6acf99c9-426c-44c7-b4c6-6e0a659ed6aa(cell1) {{(pid=102048) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 14:55:56.846215 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 14:55:56.848093 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 14:55:56.848901 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_concurrency.lockutils [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 14:55:56.849001 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 14:55:56.850475 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_concurrency.lockutils [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 14:55:56.850907 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 14:55:56.851302 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_concurrency.lockutils [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 14:55:56.853239 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_concurrency.lockutils [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 14:55:56.861592 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_db.sqlalchemy.engines [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:56.864436 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_db.sqlalchemy.engines [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:56.868107 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_db.sqlalchemy.engines [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:56.870519 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_db.sqlalchemy.engines [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:57.124108 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_db.sqlalchemy.engines [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:57.126875 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG oslo_db.sqlalchemy.engines [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 14:55:57.469605 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: WARNING keystonemiddleware.auth_token [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 14:55:57.470696 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: WARNING keystonemiddleware.auth_token [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 14:55:57.476263 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: WARNING keystonemiddleware.auth_token [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 14:55:57.477451 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: WARNING keystonemiddleware.auth_token [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 14:55:57.699136 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: WARNING keystonemiddleware.auth_token [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 14:55:57.702402 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: WARNING keystonemiddleware.auth_token [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 14:55:57.704480 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: WARNING keystonemiddleware.auth_token [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 14:55:57.707558 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: WARNING keystonemiddleware.auth_token [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 14:55:57.709831 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e3ea099c0 pid: 102047 (default app) Nov 19 14:55:57.711872 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:55:57.712866 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e3ea099c0 pid: 102048 (default app) Nov 19 14:55:57.713080 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-9f881891-7f9d-49ee-a685-842cf409026c None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Nov 19 14:55:57.713490 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Nov 19 14:55:57 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:17.933722 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:17.935018 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002715 Nov 19 14:57:17.935430 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:17 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:18.488572 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-bd65ca14-6726-4bf4-957d-91a12dedaa52 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:18.517813 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-bd65ca14-6726-4bf4-957d-91a12dedaa52 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.575665 Nov 19 14:57:18.518583 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Nov 19 14:57:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:57:20.835437 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:20.837378 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-6892f3de-0bef-4256-90c3-f99b22ec08bc None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002271 Nov 19 14:57:20.843849 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:20 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:20.900429 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-1258524e-d670-4fd9-adaf-bfa60446cdee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:20.920133 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 14:57:20.920133 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 14:57:20.947742 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-1258524e-d670-4fd9-adaf-bfa60446cdee admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102452 Nov 19 14:57:20.948586 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:20 2021] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:21.318310 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-5a8ad9fb-1a03-478f-a4b9-4f6ea65ad092 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:21.320809 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 14:57:21.320809 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: warnings.warn(msg) Nov 19 14:57:21.373022 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-5a8ad9fb-1a03-478f-a4b9-4f6ea65ad092 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.415377 Nov 19 14:57:21.373532 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Nov 19 14:57:20 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:57:23.711519 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-1258524e-d670-4fd9-adaf-bfa60446cdee admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:23.712539 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-1258524e-d670-4fd9-adaf-bfa60446cdee admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 19 14:57:23.713298 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:23.835608 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-f5ed45a8-7517-4a61-9619-1334a6b76eb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:23.854007 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 14:57:23.854007 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: warnings.warn(msg) Nov 19 14:57:23.876625 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-f5ed45a8-7517-4a61-9619-1334a6b76eb5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155478 Nov 19 14:57:23.877211 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:23.889854 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-9eb4c72d-7ecd-4dce-9640-4d5f13af69e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:23.891262 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 14:57:23.891262 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 14:57:23.925790 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-9eb4c72d-7ecd-4dce-9640-4d5f13af69e1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040081 Nov 19 14:57:23.927021 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Nov 19 14:57:23 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 14:57:26.200772 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-f5ed45a8-7517-4a61-9619-1334a6b76eb5 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:26.201736 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-f5ed45a8-7517-4a61-9619-1334a6b76eb5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 19 14:57:26.202145 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:26.265551 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-bb5ec784-91ea-4c5c-a8e8-56f46f3d98c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 1024, "id": "d2", "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:26.286455 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-bb5ec784-91ea-4c5c-a8e8-56f46f3d98c8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077187 Nov 19 14:57:26.287292 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:26.300151 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-6fa9d59c-a3e7-465a-a686-222d4291bde6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:26.322237 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-6fa9d59c-a3e7-465a-a686-222d4291bde6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025865 Nov 19 14:57:26.323064 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Nov 19 14:57:26 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 14:57:28.613542 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-bb5ec784-91ea-4c5c-a8e8-56f46f3d98c8 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:28.615288 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-bb5ec784-91ea-4c5c-a8e8-56f46f3d98c8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Nov 19 14:57:28.616053 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:28.683814 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-df56256f-f575-494f-887e-6b51678cfc43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:28.702687 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-df56256f-f575-494f-887e-6b51678cfc43 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079226 Nov 19 14:57:28.703158 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:28.715892 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-e10a7d18-fd07-45c2-a8c3-ee1561d9d2ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:28.737699 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-e10a7d18-fd07-45c2-a8c3-ee1561d9d2ba admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026087 Nov 19 14:57:28.738264 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Nov 19 14:57:28 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 14:57:31.042411 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-df56256f-f575-494f-887e-6b51678cfc43 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:31.043405 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-df56256f-f575-494f-887e-6b51678cfc43 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 19 14:57:31.043803 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:31.105591 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:31.126533 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076088 Nov 19 14:57:31.128029 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:31.141187 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-184b256a-adde-4842-ab81-a100e6e42de3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:31.165155 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-184b256a-adde-4842-ab81-a100e6e42de3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027603 Nov 19 14:57:31.165969 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Nov 19 14:57:31 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:57:33.461157 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:33.462162 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 19 14:57:33.462573 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:33.532586 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-42fc2919-2a96-437b-a9ba-3ca3aecdb330 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:33.562032 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-42fc2919-2a96-437b-a9ba-3ca3aecdb330 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092250 Nov 19 14:57:33.562792 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Nov 19 14:57:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:57:35.889670 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:35.890750 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-8d883338-8ddf-44ee-98c1-11365cdb279f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Nov 19 14:57:35.891076 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:35.952291 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-9cb1bac0-2559-4a41-86b4-4de5abb70526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:35.970238 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-9cb1bac0-2559-4a41-86b4-4de5abb70526 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071708 Nov 19 14:57:35.970800 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:35 2021] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:35.983001 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-698d5362-af13-4f1a-97de-85a7fd13ba78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:36.006088 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-698d5362-af13-4f1a-97de-85a7fd13ba78 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026468 Nov 19 14:57:36.006688 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Nov 19 14:57:35 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:57:38.315615 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-9cb1bac0-2559-4a41-86b4-4de5abb70526 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:38.316960 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-9cb1bac0-2559-4a41-86b4-4de5abb70526 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001839 Nov 19 14:57:38.317508 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:38.387478 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-1fa54d3f-29ee-4def-90f3-3cc0ec09ce01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:38.405772 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-1fa54d3f-29ee-4def-90f3-3cc0ec09ce01 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079690 Nov 19 14:57:38.406354 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:38.420508 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-28deca60-ef01-4f12-9ecd-8fde4083e076 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:38.447250 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-28deca60-ef01-4f12-9ecd-8fde4083e076 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031994 Nov 19 14:57:38.448698 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Nov 19 14:57:38 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 14:57:40.705046 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-1fa54d3f-29ee-4def-90f3-3cc0ec09ce01 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:40.706050 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-1fa54d3f-29ee-4def-90f3-3cc0ec09ce01 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 19 14:57:40.706449 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:40.766479 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-767e3da3-7ebb-4319-a670-ad37aa4d244e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "name": "m1.medium", "id": "3"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:40.784610 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-767e3da3-7ebb-4319-a670-ad37aa4d244e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071921 Nov 19 14:57:40.785218 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:40 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 14:57:40.797961 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-b3e18558-17b3-40f4-96c6-0db301cc68a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:40.823084 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-b3e18558-17b3-40f4-96c6-0db301cc68a5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028694 Nov 19 14:57:40.823681 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Nov 19 14:57:40 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:57:43.115158 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-767e3da3-7ebb-4319-a670-ad37aa4d244e admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:43.116332 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-767e3da3-7ebb-4319-a670-ad37aa4d244e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Nov 19 14:57:43.116984 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:43.179748 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-2b57c0e0-a366-41b6-8793-80eea0ce33ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:43.198832 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-2b57c0e0-a366-41b6-8793-80eea0ce33ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075234 Nov 19 14:57:43.199477 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:43 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 14:57:43.212828 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-a16c17c5-330d-4c60-a83d-f3d71f37e4d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:43.236440 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-a16c17c5-330d-4c60-a83d-f3d71f37e4d1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027485 Nov 19 14:57:43.237273 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Nov 19 14:57:43 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 14:57:45.623066 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-2b57c0e0-a366-41b6-8793-80eea0ce33ea admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:57:45.624066 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-2b57c0e0-a366-41b6-8793-80eea0ce33ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 19 14:57:45.628898 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:57:45 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:57:45.687471 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:45.708158 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077383 Nov 19 14:57:45.709011 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Nov 19 14:57:45 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:57:45.721298 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-b80e444a-a51a-499b-a2fc-63afb963a228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:57:45.746928 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-b80e444a-a51a-499b-a2fc-63afb963a228 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029407 Nov 19 14:57:45.747672 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Nov 19 14:57:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:58:07.333174 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:07.334205 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 19 14:58:07.334602 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:58:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:07.392508 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-a7ac88aa-aaed-417f-b70f-3ca15f80b727 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:07.409533 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-a7ac88aa-aaed-417f-b70f-3ca15f80b727 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067508 Nov 19 14:58:07.410066 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Nov 19 14:58:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:58:08.887854 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:08.888898 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-773c2f08-60f5-4fdd-aaea-6b29be7ed60c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Nov 19 14:58:08.889329 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:09.076581 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-8436f182-25a1-4a4c-bc2d-6dbe5883a99e admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:09.081943 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.wsgi [None req-8436f182-25a1-4a4c-bc2d-6dbe5883a99e admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 14:58:09.082498 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-8436f182-25a1-4a4c-bc2d-6dbe5883a99e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:09.083275 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-8436f182-25a1-4a4c-bc2d-6dbe5883a99e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056235 Nov 19 14:58:09.083773 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Nov 19 14:58:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 14:58:09.094080 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-3ddb235f-2ffe-4226-80ef-e08d4c8c53f9 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:09.114954 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-3ddb235f-2ffe-4226-80ef-e08d4c8c53f9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024432 Nov 19 14:58:09.115486 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 14:58:09.125522 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-2dde62d5-8731-4899-9b93-8956857a8cd5 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:09.145631 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-2dde62d5-8731-4899-9b93-8956857a8cd5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023585 Nov 19 14:58:09.146155 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:58:09.156508 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-081a2858-14b8-43a4-a31a-b8b55d7fbcfd admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:09.161853 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.wsgi [None req-081a2858-14b8-43a4-a31a-b8b55d7fbcfd admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 14:58:09.162412 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-081a2858-14b8-43a4-a31a-b8b55d7fbcfd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:09.163197 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-081a2858-14b8-43a4-a31a-b8b55d7fbcfd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010256 Nov 19 14:58:09.163691 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Nov 19 14:58:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 19 14:58:10.544124 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-2dde62d5-8731-4899-9b93-8956857a8cd5 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:10.545165 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-2dde62d5-8731-4899-9b93-8956857a8cd5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Nov 19 14:58:10.545560 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:10.733922 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-1bb7ec34-b338-4d69-b7b3-448ab8271289 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:10.739511 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.wsgi [None req-1bb7ec34-b338-4d69-b7b3-448ab8271289 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 14:58:10.740060 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-1bb7ec34-b338-4d69-b7b3-448ab8271289 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:10.740869 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-1bb7ec34-b338-4d69-b7b3-448ab8271289 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057353 Nov 19 14:58:10.741375 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Nov 19 14:58:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 19 14:58:10.751250 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-12db1a94-c050-44e9-9b85-5f587cbdf109 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:10.765338 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-12db1a94-c050-44e9-9b85-5f587cbdf109 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017404 Nov 19 14:58:10.765821 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:58:10.776498 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-051f8598-493e-4f2c-90c7-0d280556922d admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:10.789876 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-051f8598-493e-4f2c-90c7-0d280556922d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017658 Nov 19 14:58:10.790448 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 14:58:10.799944 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-77682158-41b5-4991-8071-000a188cb3a7 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:10.805041 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.wsgi [None req-77682158-41b5-4991-8071-000a188cb3a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 14:58:10.805590 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-77682158-41b5-4991-8071-000a188cb3a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:10.806437 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-77682158-41b5-4991-8071-000a188cb3a7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009961 Nov 19 14:58:10.806916 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Nov 19 14:58:10 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 14:58:12.172189 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-051f8598-493e-4f2c-90c7-0d280556922d admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:12.173215 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-051f8598-493e-4f2c-90c7-0d280556922d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 19 14:58:12.173624 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:12.363710 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-c83d351f-92d5-4ec7-922d-7b340fd50944 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:12.369531 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.wsgi [None req-c83d351f-92d5-4ec7-922d-7b340fd50944 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 14:58:12.370084 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-c83d351f-92d5-4ec7-922d-7b340fd50944 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:12.370860 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-c83d351f-92d5-4ec7-922d-7b340fd50944 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059117 Nov 19 14:58:12.371361 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 14:58:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 14:58:12.381008 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-476ce79b-493a-4558-aed7-a6adad534282 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:12.394131 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-476ce79b-493a-4558-aed7-a6adad534282 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016644 Nov 19 14:58:12.394676 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:58:12.404867 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:12.417996 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017093 Nov 19 14:58:12.418548 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Nov 19 14:58:12 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:58:12.427729 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-b982644e-4654-460b-8af1-25893b58b1b2 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:12.433553 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.wsgi [None req-b982644e-4654-460b-8af1-25893b58b1b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 14:58:12.434202 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-b982644e-4654-460b-8af1-25893b58b1b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 14:58:12.434987 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-b982644e-4654-460b-8af1-25893b58b1b2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010632 Nov 19 14:58:12.435485 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 14:58:12 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 14:58:13.815535 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:13.816673 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Nov 19 14:58:13.817114 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:14.007653 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-5f46f743-8e3b-4574-b3b6-333647f172ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:58:14.025212 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-5f46f743-8e3b-4574-b3b6-333647f172ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069216 Nov 19 14:58:14.025750 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Nov 19 14:58:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:58:15.387850 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:15.388884 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Nov 19 14:58:15.389347 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:15.587847 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-8d37e448-4e6e-40a9-8d3b-0ac25a004320 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:58:15.605527 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-8d37e448-4e6e-40a9-8d3b-0ac25a004320 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070293 Nov 19 14:58:15.606007 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Nov 19 14:58:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:58:16.990856 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:16.991855 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Nov 19 14:58:16.992250 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:17.183114 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-daea55e6-b388-45bc-8209-23680146e620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:58:17.201563 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-daea55e6-b388-45bc-8209-23680146e620 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069656 Nov 19 14:58:17.202102 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Nov 19 14:58:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 14:58:18.578843 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:18.579840 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 19 14:58:18.580232 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:18.773261 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-565d72db-882f-4e18-b811-2dd3737a6568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 14:58:18.791584 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-565d72db-882f-4e18-b811-2dd3737a6568 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069006 Nov 19 14:58:18.792058 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Nov 19 14:58:18 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 14:58:20.173027 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:20.174021 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 19 14:58:20.174411 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 14:58:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:58:20.364151 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-8098e8d0-087c-4ac8-bb7b-0b5f0a39aed0 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:58:20.382797 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-8098e8d0-087c-4ac8-bb7b-0b5f0a39aed0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069511 Nov 19 14:58:20.383258 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Nov 19 14:58:20 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:59:06.282929 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.283921 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d45552cf-ae85-41f2-8cad-66fb93be7601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 19 14:59:06.284324 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 14:59:06.340919 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-5a54b513-f4fc-46a8-a40e-71b7d3c345a8 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.360361 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-5a54b513-f4fc-46a8-a40e-71b7d3c345a8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069115 Nov 19 14:59:06.361030 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 14:59:06.383424 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-16996690-db92-4165-b477-14040d70bb5d admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.390932 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-16996690-db92-4165-b477-14040d70bb5d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011526 Nov 19 14:59:06.391441 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:59:06.403639 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-256de97d-97e1-4175-be61-0589652cc218 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.411019 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-256de97d-97e1-4175-be61-0589652cc218 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010879 Nov 19 14:59:06.411531 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:59:06.422795 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-7a684d05-d90b-46b6-8804-fe989a4bfa40 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.430089 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-7a684d05-d90b-46b6-8804-fe989a4bfa40 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010652 Nov 19 14:59:06.430601 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 14:59:06.441902 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 14:59:06.450351 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011809 Nov 19 14:59:06.450863 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Nov 19 14:59:06 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:00:28.253288 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-d1b79bb2-9500-4a8d-be52-600bc216f66b tempest-verify_tempest_config-330805792 tempest-verify_tempest_config-330805792-project] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:00:28.255245 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-d1b79bb2-9500-4a8d-be52-600bc216f66b tempest-verify_tempest_config-330805792 tempest-verify_tempest_config-330805792-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104843 Nov 19 15:00:28.256563 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Nov 19 15:00:28 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:01:58.821259 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:01:58.822310 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Nov 19 15:01:58.822714 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 15:01:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:01:59.078431 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:01:59.079566 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:01:59.079566 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 15:01:59.081102 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:01:59.081540 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:01:59.082319 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:01:59.082743 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:01:59.115579 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-f6480c1b-8ba5-4a3d-a941-4bc1c94e472c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147989 Nov 19 15:01:59.116217 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 36/71] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 15:01:58 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:02:00.530489 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:00.531477 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Nov 19 15:02:00.531875 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 15:02:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:02:00.723340 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:00.724506 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:02:00.724506 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 15:02:00.726027 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:00.726472 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:00.727274 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:00.727705 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:00.746679 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-a902bbd3-33b6-40a7-8d42-918fcd6983a1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074591 Nov 19 15:02:00.747238 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 37/73] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 15:02:00 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:02:12.575200 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:12.576199 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 19 15:02:12.576594 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 15:02:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:02:12.768889 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:12.770043 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:02:12.770043 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 15:02:12.772461 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:12.772932 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:12.773758 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:12.774191 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:12.798821 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-0dc5d8a5-7697-4638-80b9-0464e644fe97 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081632 Nov 19 15:02:12.799317 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 38/75] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 15:02:12 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:02:14.199206 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: DEBUG nova.api.openstack.wsgi [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] Calling method '>' {{(pid=102048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:14.200205 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: INFO nova.api.openstack.requestlog [None req-c6d0e95b-64d7-405a-95bf-b4f976a935a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 19 15:02:14.200607 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: [pid: 102048|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Nov 19 15:02:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:02:14.393695 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG nova.api.openstack.wsgi [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] Calling method '>' {{(pid=102047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:02:14.394866 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:02:14.394866 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: warnings.warn(msg) Nov 19 15:02:14.397314 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:14.397761 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:14.398592 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:02:14.399031 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: DEBUG oslo_concurrency.lockutils [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:02:14.420589 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: INFO nova.api.openstack.requestlog [None req-ed872cc5-37da-4326-a734-52fc6020d6c0 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078349 Nov 19 15:02:14.421110 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: [pid: 102047|app: 0|req: 39/77] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Nov 19 15:02:14 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:03:13.376858 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: Fri Nov 19 15:03:13 2021 - graceful shutdown triggered... Nov 19 15:03:13.376996 dv-cinder-817573-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 19 15:03:13.377783 dv-cinder-817573-1-iscsi devstack@n-api.service[102048]: Gracefully killing worker 2 (pid: 102048)... Nov 19 15:03:13.378151 dv-cinder-817573-1-iscsi devstack@n-api.service[102047]: Gracefully killing worker 1 (pid: 102047)... Nov 19 15:03:14.378902 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: worker 1 buried after 1 seconds Nov 19 15:03:14.379417 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: worker 2 buried after 1 seconds Nov 19 15:03:14.379417 dv-cinder-817573-1-iscsi devstack@n-api.service[102046]: goodbye to uWSGI. Nov 19 15:03:14.380493 dv-cinder-817573-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 19 15:03:14.381078 dv-cinder-817573-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 19 15:03:14.383865 dv-cinder-817573-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 15:03:14.393126 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 15:03:14 2021] *** Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: nodename: dv-cinder-817573-1-iscsi Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: machine: x86_64 Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: clock source: unix Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: pcre jit disabled Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: detected number of CPU cores: 4 Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: current working directory: / Nov 19 15:03:14.395113 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: detected binary path: /usr/bin/uwsgi-core Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: your processes number limit is 47680 Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: your memory page size is 4096 bytes Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: detected max file descriptor number: 2048 Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: lock engine: pthread robust mutexes Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: thunder lock: enabled Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 15:03:14.395923 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 15:03:14.443893 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: Python main interpreter initialized at 0x557932b179c0 Nov 19 15:03:14.443893 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: python threads support enabled Nov 19 15:03:14.443893 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: your server socket listen backlog is limited to 100 connections Nov 19 15:03:14.443893 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: your mercy for graceful operations on workers is 90 seconds Nov 19 15:03:14.444352 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 15:03:14.444352 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: *** Operational MODE: preforking *** Nov 19 15:03:14.444627 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: *** uWSGI is running in multiple interpreter mode *** Nov 19 15:03:14.444627 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: spawned uWSGI master process (pid: 116246) Nov 19 15:03:14.444857 dv-cinder-817573-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 15:03:14.445464 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: spawned uWSGI worker 1 (pid: 116265, cores: 1) Nov 19 15:03:14.447078 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: spawned uWSGI worker 2 (pid: 116266, cores: 1) Nov 19 15:03:14.447078 dv-cinder-817573-1-iscsi devstack@n-api.service[116246]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 15:03:16.205907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 15:03:16.205907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: from cryptography.utils import int_from_bytes Nov 19 15:03:16.207201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 15:03:16.207201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: from cryptography.utils import int_from_bytes Nov 19 15:03:16.235759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 15:03:16.235759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: from cryptography.utils import int_from_bytes Nov 19 15:03:16.236421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 15:03:16.236421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: from cryptography.utils import int_from_bytes Nov 19 15:03:18.536019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 15:03:18.536552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 15:03:18.536783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 15:03:18.537091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 15:03:18.537357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 15:03:18.537755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.538092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.538423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.538752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.539093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.539421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.539758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.540089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.540427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.540698 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.541067 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.541403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817573-1-iscsi {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.541735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.542052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.542372 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.542697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.543011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.543350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.543667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.544173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.545250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.545830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.546188 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.546582 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.546926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.547281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.547641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.547964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.548316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.548650 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.549145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817573-1-iscsi {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.549491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.549852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.550924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.551369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.551703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.552036 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.552408 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.552773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.553122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.553499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.553958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.554525 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.554956 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.555285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.555615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.555946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.556286 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.556667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.557023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.557293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.557619 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.557960 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.558298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.558639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.558910 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.559176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.559511 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.559859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.560174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.560498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.560976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.561301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.561622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.561945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.562266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.562589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.562924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.563283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.563621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.564065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.564644 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.565092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.565360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.566292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.566656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.566994 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.567320 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.567656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.567994 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.568317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.568639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.568992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.569331 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.569761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.570075 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.570340 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.570654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.571084 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.571428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.571751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.571904 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 15:03:18.572386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.572536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 15:03:18.572692 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.572877 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 15:03:18.573043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.573197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 15:03:18.573354 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.573515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 15:03:18.573674 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.573828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574170 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.574935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575535 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.575998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.576153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.576307 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.576465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.576620 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.576773 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577326 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817573-1-iscsi {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.577921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578246 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.578868 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579172 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.579917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.580119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.580335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.580335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.580713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.580973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.581145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.581421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.581662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.581952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582123 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582746 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.582901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583047 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583346 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817573-1-iscsi {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.583960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.584251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.584668 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.585453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.585453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.585949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.586107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.586107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.586401 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.586610 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.586940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.587260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.587586 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.587899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.588215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.588535 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.588962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.589285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.589602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.590133 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.590462 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.590797 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.594655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.594878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595219 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.595854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.596778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597189 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.597977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598597 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.598914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.598914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.599194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.599340 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.599493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.599651 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.599806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.601859 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.602041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.602202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.602360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.602360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.602649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.602649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.602937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.603092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.603241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.603397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.603566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.603721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.603867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.604020 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.604173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.604334 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.604481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.604635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.604806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.604961 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.605108 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.605108 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.605428 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.605592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.605747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.605903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.606056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.606216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.606365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.606510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.606662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.606815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.606975 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.607123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.607279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.607443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.607589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.607743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.607898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.608051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.608198 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.608198 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.608482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.608628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.608786 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.608983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.610378 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.610561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.610561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.610888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.611054 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.611202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.611357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.611504 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.611668 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.611826 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.611983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.612137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.612283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.612283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.613119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.613298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.613446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.613591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.613750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.613904 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.614051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.614211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.614358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.614504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.614504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.614788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.617275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.617482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.617657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.617812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.617981 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.618141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.618325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.618554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.618719 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.618907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.619143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.619356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.619509 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.619664 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.619822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.619822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.620164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.620383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.620383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.620673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.620954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.621154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.621319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.621475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.621643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.621794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.621940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.622139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.622502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.622663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.622819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.622974 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.623131 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.623287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.623287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.623573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.623726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.623881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.624035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.624225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.624225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.624556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.624707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.624887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.625076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.625255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.625411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.625411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.625696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.625850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.626005 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.626314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.626484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.627516 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 15:03:18.627679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.627840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.628005 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.628822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.628991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629289 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.629913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630220 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630366 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630524 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630524 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630784 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.630927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631180 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631486 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.631812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.632136 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.632291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.632445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.633234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.633439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.633603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.636472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.637589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.637749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.637916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638388 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.638978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639565 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.639720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.640982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642275 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642431 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.642916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643080 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.643998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.644283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.644444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.644591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.644744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.644929 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.645967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.646414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.647866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.648293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.648439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.648601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.648853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649015 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649469 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.649775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650187 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.650925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.651218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.651754 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652302 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.652980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.653999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.654745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655174 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655332 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655486 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655785 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.655939 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656549 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.656868 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657019 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657019 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.657972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658431 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.658745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659227 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659474 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659636 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659791 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.659958 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660120 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660435 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.660977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.661152 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.661258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.661346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.661561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.661561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662539 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662886 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.662986 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663165 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663250 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663800 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663979 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.663979 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.664936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665391 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665579 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665756 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.665932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.666016 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.666750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.666853 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.666940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667217 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.667897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.668097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.668416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.668751 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.669155 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.669475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.669803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.670124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.670444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.670776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.671127 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.671447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.671778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.672102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.672424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.672742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.673108 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.673428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.673748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.674068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.674383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.674703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.675552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.676140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.676486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.681953 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682028 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682652 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682868 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.682951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683817 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.683899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684030 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684426 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684426 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.684739 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686693 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.686920 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687809 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.687984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688213 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.688941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.689018 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.689099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.689181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.689262 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.689346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.690238 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.690395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.690600 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.691288 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.691450 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.691617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.691780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.691936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692091 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.692884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.693981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.694135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.694304 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.694496 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.694654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695433 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.695965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696612 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696776 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.696956 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.697973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698299 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698299 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.698920 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.699899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700717 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.700931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701579 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.701917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.702081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.702250 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.702486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.702682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.702838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703331 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.703975 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.704142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.704142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.704442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.704598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.704763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.705109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.705109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.706876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707351 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707811 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.707986 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.708154 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.708317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.708473 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.708637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.708911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.709863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710018 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.710881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711037 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711408 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.711940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.712933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.713918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714080 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714477 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714788 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.714943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.715275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.715446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.715446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.715446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.716024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.716447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.717409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.717575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.717731 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.717885 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718374 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718538 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.718898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719227 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719390 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719716 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.719880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720367 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720521 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.720849 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.721996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.722955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723120 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723288 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.723907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.724867 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.725029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.725203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.725560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.725726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.725891 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.726077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.726351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.726512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.726676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.726928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727405 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.727994 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728595 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728682 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728882 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.728982 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729254 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729530 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729786 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729890 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.729967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730070 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730242 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.730949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.731412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.732517 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.732609 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.732703 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.732842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.732946 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733130 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733219 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733500 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733585 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733680 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733769 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.733954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734886 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.734977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735227 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.735980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736079 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736271 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.736733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.737109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.737213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.737958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.738078 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.738411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.738506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.738732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.738827 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.739060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.739227 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.739382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.739500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740704 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.740827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741478 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.741805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.742040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.742131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.742362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.742446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.742689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743668 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.743884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744207 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744311 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.744957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.745183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.745292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.745521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.745800 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.745914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.746010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.746142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.746247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.746458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.746560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.747978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.748991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749728 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.749947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.750991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751322 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.751964 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.752186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.752272 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.752499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.752582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.752841 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.753178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.753925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.754026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755029 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.755959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.756056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.756140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.756336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.756481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.756672 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759242 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.759907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760733 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.760900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761419 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761784 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.761921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762374 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762459 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.762827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763006 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763308 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763820 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.763919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764299 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764514 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764659 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.764946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.765163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.765295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.765573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.765801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.765924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766460 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.766937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.767138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.767312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.767469 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.767670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.767819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.768003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.768300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.768397 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.768639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.768916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769208 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769337 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.769853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770179 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.770815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771036 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771453 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771769 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.771992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772624 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.772990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773760 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.773990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774302 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.774936 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.775955 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776592 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.776946 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.777911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.778131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.778373 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.778477 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.778710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.778824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779461 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.779791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780320 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780741 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.780991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.781200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.781307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.781558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.781875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.781972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782211 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782312 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782537 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.782959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.783916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.784140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.784247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.784607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.784738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.784968 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785290 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785719 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.785938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786261 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.786904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787001 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787551 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787868 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.787963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788849 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.788962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789316 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.789906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790226 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.790854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791070 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.791844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.792029 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.792163 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.792351 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.792688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793070 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793391 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.793847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794036 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794363 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.794900 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795558 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.795881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.796121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.796205 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.796482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.796603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.796841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.797966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798321 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798684 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798787 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.798978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799172 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.799796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.800613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.800723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.800829 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.801990 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802441 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802767 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.802988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.803958 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.804955 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805592 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.805910 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806226 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.806893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807265 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.807930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.808923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809102 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.809908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810346 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.810898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811333 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811547 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811641 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811867 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.811971 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812184 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812288 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812849 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.812967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.813911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814227 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814455 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.814873 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.815097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.815192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.815454 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.815578 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.816420 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.816532 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.816779 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817035 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817163 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817379 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817711 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.817806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818037 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818132 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818452 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.818791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.819963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.820937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821365 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.821895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822532 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.822961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.823954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824164 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824837 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.824936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.825877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826208 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826539 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.826857 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.827923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.828162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.828257 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.828529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.828917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.829241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.829327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.829496 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 15:03:18.829594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.829905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.830245 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.830573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.830907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.831822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.832092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.832448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.832844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.833157 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.833478 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.833797 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.834115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.834438 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.834781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.835127 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.835460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.835784 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.836104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.836439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.836759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.837118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.837464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.837782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.838106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.838446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.838765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.839102 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.839409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.839728 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.840052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.840368 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.840707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.841071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.841653 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.841989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.842318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.842646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.842972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.843294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.843635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.843956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.844284 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.844606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.844948 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.845279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.845604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.845942 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.846281 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.846619 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.847568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.848192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.848528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.848913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.849263 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.849654 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.850991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.851327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 15:03:18.852911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 15:03:18.854740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_db.sqlalchemy.engines [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:18.874125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.017785 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.context [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6acf99c9-426c-44c7-b4c6-6e0a659ed6aa(cell1) {{(pid=116265) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 15:03:19.022866 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:19.024454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:19.025319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:19.027285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:19.039156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_db.sqlalchemy.engines [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.039472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_db.sqlalchemy.engines [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.042725 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.context [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6acf99c9-426c-44c7-b4c6-6e0a659ed6aa(cell1) {{(pid=116266) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 15:03:19.049341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:19.051092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:19.051883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:19.053911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:19.064716 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.067153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.208670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_db.sqlalchemy.engines [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.236538 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 15:03:19.536622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: WARNING keystonemiddleware.auth_token [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 15:03:19.543209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: WARNING keystonemiddleware.auth_token [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 15:03:19.562182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 15:03:19.569346 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 15:03:19.913036 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: WARNING keystonemiddleware.auth_token [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 15:03:19.918348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: WARNING keystonemiddleware.auth_token [None req-ca83cdae-be96-4013-8c37-af7c2b1d848f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 15:03:19.923706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557932b179c0 pid: 116265 (default app) Nov 19 15:03:19.930528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 15:03:19.935782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-02a7edfc-6996-433c-92fa-daea36393b54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 15:03:19.942098 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557932b179c0 pid: 116266 (default app) Nov 19 15:03:52.632415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-61687f76-ac60-4fb5-952f-dd9f8d699c5a tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Action: 'create', calling method: .version_select at 0x7f37cd4995e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-595263977", "metadata": {"Type": "work"}}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:03:54.711249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-61687f76-ac60-4fb5-952f-dd9f8d699c5a tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.145845 Nov 19 15:03:54.722019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Nov 19 15:03:51 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3158 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 15:03:54.730048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8fc4efec-b98b-4f6f-a610-c807b0567add tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Calling method '.version_select at 0x7f37cd3631f0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:54.884418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8fc4efec-b98b-4f6f-a610-c807b0567add tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a" status: 200 len: 352 microversion: 2.1 time: 0.160636 Nov 19 15:03:54.885295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:03:54 2021] GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:55.019956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe5cebbc-e2b5-4b19-a2dd-a064ed399873 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Action: 'create', calling method: .version_select at 0x7f37cd49a5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-447825586"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:03:55.897938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e4c43d21-0a79-4844-8e3c-376471ef1e5b tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Calling method '.version_select at 0x7f37cd3639d0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:56.107451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e4c43d21-0a79-4844-8e3c-376471ef1e5b tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a" status: 200 len: 353 microversion: 2.1 time: 0.214181 Nov 19 15:03:56.108603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:03:55 2021] GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:03:56.207679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-209095756", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "3c9cca4b-ed41-4a56-84cf-c924ddaee6d8"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:03:56.389046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] validate_networks() for [('3c9cca4b-ed41-4a56-84cf-c924ddaee6d8', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:03:56.449872 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe5cebbc-e2b5-4b19-a2dd-a064ed399873 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.014069 Nov 19 15:03:56.456845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1/4] 10.222.0.20 () {60 vars in 1154 bytes} [Fri Nov 19 15:03:53 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3017 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 15:03:56.466393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b1c820d-956a-4ffa-bdad-bbdd1a81af5b tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Calling method '.version_select at 0x7f37cd3631f0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:56.598328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b1c820d-956a-4ffa-bdad-bbdd1a81af5b tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a" status: 200 len: 353 microversion: 2.1 time: 0.138425 Nov 19 15:03:56.599188 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:03:56 2021] GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:56.604429 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6899c0b1-489c-4c95-a951-b54b063eb0fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cd363a60>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:56.696119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6899c0b1-489c-4c95-a951-b54b063eb0fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 200 len: 345 microversion: 2.1 time: 0.095374 Nov 19 15:03:56.696682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:03:56 2021] GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:56.702648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5d9c1926-2e44-46b4-8247-b7462eed4479 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Calling method '.version_select at 0x7f37cd363b80>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:56.814524 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5d9c1926-2e44-46b4-8247-b7462eed4479 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a" status: 202 len: 0 microversion: 2.1 time: 0.116694 Nov 19 15:03:56.815675 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:03:56 2021] DELETE /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:03:56.826724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6425ce95-0b78-45d3-950d-506e98773b8f tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Action: 'create', calling method: .version_select at 0x7f37cd379310>, body: {"snapshot": {"volume_id": "109b71e8-e2dc-4735-a8f7-11f14027706e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-254799579"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:03:57.329479 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6425ce95-0b78-45d3-950d-506e98773b8f tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.508767 Nov 19 15:03:57.330441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 5/8] 10.222.0.20 () {60 vars in 1161 bytes} [Fri Nov 19 15:03:56 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:57.337143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6de52680-6bad-498a-b7cb-72d4dc86d7d5 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Calling method '.version_select at 0x7f37cd363ee0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:57.409309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-6de52680-6bad-498a-b7cb-72d4dc86d7d5 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] HTTP exception thrown: Volume d3e93752-56ee-45af-b434-801fc1d8559a could not be found. Nov 19 15:03:57.412178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6de52680-6bad-498a-b7cb-72d4dc86d7d5 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] Returning 404 to user: Volume d3e93752-56ee-45af-b434-801fc1d8559a could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:03:57.413065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6de52680-6bad-498a-b7cb-72d4dc86d7d5 tempest-VolumesGetTestJSON-1773017779 tempest-VolumesGetTestJSON-1773017779-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a" status: 404 len: 109 microversion: 2.1 time: 0.081631 Nov 19 15:03:57.418017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:03:57 2021] GET /compute/v2.1/os-volumes/d3e93752-56ee-45af-b434-801fc1d8559a => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:03:57.425247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-244ab105-04c5-41c2-9c16-737f3fefff2b tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cdd3faf0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:57.495377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-244ab105-04c5-41c2-9c16-737f3fefff2b tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 286 microversion: 2.1 time: 0.076058 Nov 19 15:03:57.496786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 7/10] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:03:57 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:57.621223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472316468", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "cd986946-8454-44e7-80e5-6d3c5bfe30eb"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:03:57.810294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] validate_networks() for [('cd986946-8454-44e7-80e5-6d3c5bfe30eb', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:03:58.826679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:03:58.827849 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:03:58.828648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:03:58.829165 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:03:58.829694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:03:58.857329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:58.858192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:58.860489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:58.861952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:58.934111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Getting quotas for project 4f706bd80a9247579246ab8d0ec2203d. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:03:58.950719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Getting quotas for user 8f3c7789b1fd4da9a9a37d75ee40c66e and project 4f706bd80a9247579246ab8d0ec2203d. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:03:59.003518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:03:59.009382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:03:59.169611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0e530059-f160-4041-893f-b86e110b52bc tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.059488 Nov 19 15:03:59.176371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 4/11] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:03:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 3067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:03:59.181905 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-12ab9289-aa9e-49cd-8be2-2a4fa1d5dee2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cd268af0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:59.263731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-12ab9289-aa9e-49cd-8be2-2a4fa1d5dee2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.085690 Nov 19 15:03:59.264387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 5/12] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Nov 19 15:03:59 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:59.277459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0b3df244-49f9-4957-bf82-6b6e3dd46aa4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:59.279262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0b3df244-49f9-4957-bf82-6b6e3dd46aa4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:03:59.569769 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:03:59.571009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:03:59.571813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:03:59.572229 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:03:59.572714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:03:59.596691 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:59.598202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:59.600551 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:03:59.601745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:03:59.636279 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0b3df244-49f9-4957-bf82-6b6e3dd46aa4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:03:59.664942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0b3df244-49f9-4957-bf82-6b6e3dd46aa4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1214 microversion: 2.1 time: 0.399184 Nov 19 15:03:59.667750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:03:59 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:03:59.686153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d27aac0f-d352-4e45-afbb-d0df6ed11152 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc2235e0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:59.708861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:03:59.716561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for user ba4aff19ddd54325b884984bb6ddc144 and project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:03:59.734517 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:03:59.738446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:03:59.768111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d27aac0f-d352-4e45-afbb-d0df6ed11152 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 286 microversion: 2.1 time: 0.099025 Nov 19 15:03:59.768708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:03:59 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:03:59.891248 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3e7e2991-c273-4b58-b7b5-b363747dba29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393294 Nov 19 15:03:59.891922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 8/15] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:03:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:03:59.902493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f9ca54c-cbd9-42a5-b71c-953b6a27f018 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:03:59.903683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f9ca54c-cbd9-42a5-b71c-953b6a27f018 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:00.161531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f9ca54c-cbd9-42a5-b71c-953b6a27f018 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:00.201590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f9ca54c-cbd9-42a5-b71c-953b6a27f018 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1217 microversion: 2.1 time: 0.303077 Nov 19 15:04:00.214078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:03:59 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1217 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:00.686545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1f4d75f1-d135-46a0-99c9-911f7ae4c561 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:00.687313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1f4d75f1-d135-46a0-99c9-911f7ae4c561 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:00.789061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fbe5e9b7-d238-48b9-a7fe-58046975b283 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc233670>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:00.874502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fbe5e9b7-d238-48b9-a7fe-58046975b283 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 287 microversion: 2.1 time: 0.098007 Nov 19 15:04:00.879399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:04:00 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:00.891061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-076634d5-4ce6-4700-9059-6c79e26e54fe tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc23e040>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:00.984558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-076634d5-4ce6-4700-9059-6c79e26e54fe tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 202 len: 0 microversion: 2.1 time: 0.098320 Nov 19 15:04:00.987510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Nov 19 15:04:00 2021] DELETE /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:04:01.004542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ba67829e-53b2-49c3-b434-3c2c0703957f tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc23e700>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:01.091911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ba67829e-53b2-49c3-b434-3c2c0703957f tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 286 microversion: 2.1 time: 0.100094 Nov 19 15:04:01.092960 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 11/19] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:04:00 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:04:01.209940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1f4d75f1-d135-46a0-99c9-911f7ae4c561 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:01.230843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1e347d60-124d-4cc1-b882-5debbdfcd80d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:01.231822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1e347d60-124d-4cc1-b882-5debbdfcd80d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:01.241043 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1f4d75f1-d135-46a0-99c9-911f7ae4c561 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1214 microversion: 2.1 time: 0.559194 Nov 19 15:04:01.245486 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 9/20] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:00 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1214 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:01.355668 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1e347d60-124d-4cc1-b882-5debbdfcd80d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:01.364505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1e347d60-124d-4cc1-b882-5debbdfcd80d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1217 microversion: 2.1 time: 0.137400 Nov 19 15:04:01.367742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:01 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:02.104441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1288252d-0f03-418e-8688-2116af939244 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc221280>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:02.154136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1288252d-0f03-418e-8688-2116af939244 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 286 microversion: 2.1 time: 0.054198 Nov 19 15:04:02.159187 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:04:02 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:02.263083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:02.263902 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:02.287382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:02.299558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:02.307572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:02.310709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:02.384400 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:02.385299 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:02.412584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:02.413682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:02.416094 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:02.417329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:02.617271 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:02.641209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5240b17-07fa-464b-9e79-604ee2940fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1221 microversion: 2.1 time: 0.260739 Nov 19 15:04:02.641809 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:02 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:02.790129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:02.806103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7c19071d-d5db-4957-9846-5f2c1f6d125a tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1218 microversion: 2.1 time: 0.549161 Nov 19 15:04:02.807745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:02 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1218 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:03.168277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ae1be670-ea84-4fbd-aa2d-6562733011d9 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1a0b80>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:03.205900 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1646997147", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bdc62e5-2180-4755-99bd-fe198da300d6"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:03.265755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ae1be670-ea84-4fbd-aa2d-6562733011d9 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 200 len: 286 microversion: 2.1 time: 0.101804 Nov 19 15:04:03.266610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:04:03 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:03.339742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] validate_networks() for [('9bdc62e5-2180-4755-99bd-fe198da300d6', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:04:03.659081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:03.659990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:03.667142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:03.670824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:03.676313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:03.678570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:03.904001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:03.913420 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-11ef4648-9879-4389-a0ad-f9939e8e8e38 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1221 microversion: 2.1 time: 0.258323 Nov 19 15:04:03.929119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:03 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:03.948312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:03.949507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:03.988443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:03.988443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:03.988443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:03.988443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:04.115112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:04:04.115947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:04:04.116566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:04:04.117300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:04:04.117949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:04:04.142861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:04.144016 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:04.145937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:04.146874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:04.191097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:04.207035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f4cd4a37-22c1-45b9-8478-efd70830f122 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1218 microversion: 2.1 time: 0.276403 Nov 19 15:04:04.208658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 16/27] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:03 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:04.210545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Getting quotas for project cdb244c677264a58ae8a06742292aba4. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:04:04.231171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Getting quotas for user 91bfc8da9065458d986a23b7c96ba0c1 and project cdb244c677264a58ae8a06742292aba4. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:04:04.274167 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:04:04.280683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6712bd1e-8c58-4d9d-954d-7f8d2ddb07f4 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1b9430>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:04.284725 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:04:04.343884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-6712bd1e-8c58-4d9d-954d-7f8d2ddb07f4 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] HTTP exception thrown: Snapshot 1e38d202-6368-4fc1-b3cc-fd626e8a2e0f could not be found. Nov 19 15:04:04.344494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6712bd1e-8c58-4d9d-954d-7f8d2ddb07f4 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Returning 404 to user: Snapshot 1e38d202-6368-4fc1-b3cc-fd626e8a2e0f could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:04:04.345352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6712bd1e-8c58-4d9d-954d-7f8d2ddb07f4 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f" status: 404 len: 111 microversion: 2.1 time: 0.068665 Nov 19 15:04:04.346739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 17/28] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Nov 19 15:04:04 2021] GET /compute/v2.1/os-snapshots/1e38d202-6368-4fc1-b3cc-fd626e8a2e0f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:04:04.358409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-258ea2bf-f075-41b5-9b29-2f1cca5eb902 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cdd3da60>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:04.456868 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ee1a72ef-8b9e-41d4-b032-b3f8216ca9b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.797812 Nov 19 15:04:04.462851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 12/29] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:04:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:04:04.473996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15242648-6b77-441f-bc5b-b5d1b582decb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:04.500296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15242648-6b77-441f-bc5b-b5d1b582decb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:04.574398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-258ea2bf-f075-41b5-9b29-2f1cca5eb902 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 202 len: 0 microversion: 2.1 time: 0.215836 Nov 19 15:04:04.577401 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 18/30] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:04:04 2021] DELETE /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:04:04.594744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bf95d550-61bb-401f-9f14-c88c0d0493bf tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1a0700>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:04.703875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-15242648-6b77-441f-bc5b-b5d1b582decb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:04.712406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15242648-6b77-441f-bc5b-b5d1b582decb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1222 microversion: 2.1 time: 0.242783 Nov 19 15:04:04.738916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 13/31] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:04 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:04.756940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bf95d550-61bb-401f-9f14-c88c0d0493bf tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 200 len: 344 microversion: 2.1 time: 0.167933 Nov 19 15:04:04.757893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 19/32] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:04:04 2021] GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:04.931448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:04.932248 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:04.938495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:04.954881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:04.957009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:04.957713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:05.112419 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:05.134314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-569bf599-309c-4831-bfac-e48f5b1c94ce tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1213 microversion: 2.1 time: 0.207873 Nov 19 15:04:05.141063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 14/33] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:04 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:05.155908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-882698794", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bdc62e5-2180-4755-99bd-fe198da300d6"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:05.226019 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:05.226740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:05.234289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:05.234717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:05.241777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:05.242313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:05.281641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] validate_networks() for [('9bdc62e5-2180-4755-99bd-fe198da300d6', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:04:05.698381 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:05.737106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-44400ac3-ea06-4b0f-80d7-0786fd0d5ae7 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1266 microversion: 2.1 time: 0.501432 Nov 19 15:04:05.738117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 15/34] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:05 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:05.777549 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5f755257-1720-4ca9-88e8-f18c2ba01bf2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1a3f70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:05.884777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-5f755257-1720-4ca9-88e8-f18c2ba01bf2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] HTTP exception thrown: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. Nov 19 15:04:05.885848 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5f755257-1720-4ca9-88e8-f18c2ba01bf2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Returning 404 to user: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:04:05.887718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5f755257-1720-4ca9-88e8-f18c2ba01bf2 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 404 len: 109 microversion: 2.1 time: 0.120486 Nov 19 15:04:05.898450 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:04:05 2021] GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:04:05.907458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-98d644ca-0ddc-4bdf-9c24-84b7e386a9fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1100d0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:06.051095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-98d644ca-0ddc-4bdf-9c24-84b7e386a9fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] HTTP exception thrown: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. Nov 19 15:04:06.051730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-98d644ca-0ddc-4bdf-9c24-84b7e386a9fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Returning 404 to user: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:04:06.052914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-98d644ca-0ddc-4bdf-9c24-84b7e386a9fb tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 404 len: 109 microversion: 2.1 time: 0.152937 Nov 19 15:04:06.053472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:04:05 2021] DELETE /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:04:06.064209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a2a213b-2d93-45e8-a54c-f121b96feca5 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Calling method '.version_select at 0x7f37cc1a3a60>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:06.131079 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-6a2a213b-2d93-45e8-a54c-f121b96feca5 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] HTTP exception thrown: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. Nov 19 15:04:06.131542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a2a213b-2d93-45e8-a54c-f121b96feca5 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] Returning 404 to user: Volume 109b71e8-e2dc-4735-a8f7-11f14027706e could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:04:06.132372 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a2a213b-2d93-45e8-a54c-f121b96feca5 tempest-VolumesSnapshotsTestJSON-887798869 tempest-VolumesSnapshotsTestJSON-887798869-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e" status: 404 len: 109 microversion: 2.1 time: 0.074329 Nov 19 15:04:06.136756 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:04:06 2021] GET /compute/v2.1/os-volumes/109b71e8-e2dc-4735-a8f7-11f14027706e => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:04:06.158698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:06.160982 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:06.186233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:06.186736 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:06.190386 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:06.191956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:07.124584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:07.150609 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-16294e9f-a6e6-4660-80c2-86920634f102 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1287 microversion: 2.1 time: 0.996518 Nov 19 15:04:07.153889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:06 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1287 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:07.167034 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:07.167667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:07.198090 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:07.203140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:07.207092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:07.207743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:07.708580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:07.729446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7e23fcf-3fab-4a26-9db1-9f752449d11b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1272 microversion: 2.1 time: 0.573198 Nov 19 15:04:07.730021 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:07 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1272 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:07.972197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: .version_select at 0x7f37cc1108b0>, body: {"keypair": {"name": "tempest-keypair-1641720134"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:08.040144 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:04:08.055013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:04:08.343023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:04:08.350092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:04:08.372889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a1dca80-9f53-4b2c-82f5-1e5af50a27e8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.641339 Nov 19 15:04:08.374373 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 21/40] 10.222.0.20 () {62 vars in 1198 bytes} [Fri Nov 19 15:04:07 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 644 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:04:08.381827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:08.382999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:08.397171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.397989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.406962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.407731 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.722421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:04:08.723139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:04:08.723393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:04:08.723844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:04:08.724360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:04:08.760624 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.761342 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.762305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.762888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.786543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Getting quotas for project cdb244c677264a58ae8a06742292aba4. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:04:08.792600 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Getting quotas for user 91bfc8da9065458d986a23b7c96ba0c1 and project cdb244c677264a58ae8a06742292aba4. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:04:08.825154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:04:08.827580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:04:08.837002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:08.849051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1240759c-8eb1-47e8-8bf4-414475100316 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1275 microversion: 2.1 time: 0.472041 Nov 19 15:04:08.861861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:08 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1275 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:08.877816 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:08.881443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:08.895796 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.896254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.901138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:08.902075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:08.917886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-817442ef-cca6-4430-857c-c3df8e5137ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.766365 Nov 19 15:04:08.927631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:04:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 3777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:04:08.952957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0d90ba72-e05d-42a7-90ff-cc22376e40cd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:08.960708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0d90ba72-e05d-42a7-90ff-cc22376e40cd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:09.126522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0d90ba72-e05d-42a7-90ff-cc22376e40cd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:09.145522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0d90ba72-e05d-42a7-90ff-cc22376e40cd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1221 microversion: 2.1 time: 0.201349 Nov 19 15:04:09.156224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:08 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:09.368775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:09.401656 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a85d0b8-fa80-44e2-9197-7b2a80e3f506 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.530806 Nov 19 15:04:09.413376 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 23/44] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:08 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:09.868471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:09.869054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:09.880063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:09.883520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:09.886151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:09.886908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:10.124576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:10.138333 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c2ebe7e0-5179-4a0b-9e93-ea7a41a30bad tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.274124 Nov 19 15:04:10.139558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 22/45] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:09 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:10.163495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:10.164598 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:10.173359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:10.177140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:10.179184 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:10.180569 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:10.318107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:10.325804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b5bec44-f9a9-45ea-bb67-4e45f32322e7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1225 microversion: 2.1 time: 0.165872 Nov 19 15:04:10.333142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 24/46] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:10 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:10.422611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:10.423354 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:10.435222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:10.438066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:10.443597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:10.444586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:11.167328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:11.168214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:11.180976 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:11.184288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:11.186549 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:11.187143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:11.234775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:11.248864 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-97334bcf-7a84-4c84-9e51-b07c2de081ff tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.830645 Nov 19 15:04:11.252485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 23/47] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:10 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:11.346821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:11.347452 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:11.355293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:11.355754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:11.356554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:11.366529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:11.579537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:11.587316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9bfd64f1-4efe-4353-a415-c21b97e0c4e9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1225 microversion: 2.1 time: 0.247997 Nov 19 15:04:11.597070 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:11 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:12.181446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:12.190126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-acf62d38-2004-48eb-b4fc-b19f10a49ca4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 1.032946 Nov 19 15:04:12.221756 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 25/49] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:11 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:12.269873 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:12.273373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:12.290313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:12.296180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:12.301412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:12.304528 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:12.612292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:12.613243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:12.625545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:12.628647 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:12.632681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:12.633474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:12.822096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:12.843725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d73c0de0-8ef1-430f-98dd-16bea0a122c3 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.577492 Nov 19 15:04:12.846567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:12 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:13.050084 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:13.061793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8d1444de-b706-4c72-8134-0fdfb9e5fbb6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1225 microversion: 2.1 time: 0.453098 Nov 19 15:04:13.064944 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:12 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1225 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:13.227843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:13.229057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:13.253314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:13.255768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:13.259724 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:13.260767 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:13.638836 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-51521402", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f97c391d-7c3e-4d86-a9cf-5e771e36f18c"}], "security_groups": [{"name": "tempest-securitygroup--627471263"}], "key_name": "tempest-keypair-1641720134", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:13.998960 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:14.011313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fc10ca02-b80f-41a2-a0cc-44a0ad034458 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.806167 Nov 19 15:04:14.013196 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 26/52] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:13 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:14.032520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:14.036238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:14.054447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:14.054911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:14.055722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:14.056170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:14.374848 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] validate_networks() for [('f97c391d-7c3e-4d86-a9cf-5e771e36f18c', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:04:14.565839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:14.587641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d6c41d29-4822-402c-bb93-02cd8c848b3f tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.571628 Nov 19 15:04:14.591797 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 27/53] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:14 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:14.597606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:14.599839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:14.607009 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:14.607700 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:14.608695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:14.609325 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:14.698193 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:14.707130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-92ed9bd7-ebb3-42cd-9284-3d2c9f914fdf tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.113341 Nov 19 15:04:14.718926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 28/54] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:14 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:15.030827 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:15.031444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:15.050639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.051102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.051925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.052377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.227552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:04:15.228985 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:04:15.229795 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:04:15.230834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:04:15.231726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:04:15.245844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.246760 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.248076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.249015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.262256 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:15.279796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7d05e591-3bd4-4b5e-9fb8-441af6695a9c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.253694 Nov 19 15:04:15.309759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 29/55] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:15 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:15.316055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:04:15.320493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:04:15.331827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:04:15.334041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:04:15.411988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3b86bd5-25f5-4289-bd64-b016bd33c75c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.777512 Nov 19 15:04:15.414859 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 27/56] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Nov 19 15:04:13 2021] POST /compute/v2.1/servers => generated 401 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 15:04:15.426897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:15.427504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:15.572494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-037d1795-90ee-4c55-b4ff-e6f93b5f7597 req-91dec2df-2495-4e11-b34f-9dd9e91c4513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9389e29-4358-4ddd-9918-0f500d8364f2", "tag": "08cbe617-de50-484d-9296-d6a6db7fcc1c"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:15.575908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:15.575908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:15.606566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-037d1795-90ee-4c55-b4ff-e6f93b5f7597 req-91dec2df-2495-4e11-b34f-9dd9e91c4513 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.607023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-037d1795-90ee-4c55-b4ff-e6f93b5f7597 req-91dec2df-2495-4e11-b34f-9dd9e91c4513 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.653200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-037d1795-90ee-4c55-b4ff-e6f93b5f7597 req-91dec2df-2495-4e11-b34f-9dd9e91c4513 service nova] Creating event network-changed:08cbe617-de50-484d-9296-d6a6db7fcc1c for instance d9389e29-4358-4ddd-9918-0f500d8364f2 on hv-cinder-81757 Nov 19 15:04:15.653743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-037d1795-90ee-4c55-b4ff-e6f93b5f7597 req-91dec2df-2495-4e11-b34f-9dd9e91c4513 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116265) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 15:04:15.655051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.661896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.663162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.663797 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.677737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.compute.rpcapi [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 15:04:15.678949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=116265) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 15:04:15.728740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1b5f86aa-69d0-4177-bcb5-57d83a3bafb5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316668 Nov 19 15:04:15.730016 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 30/57] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:15.736574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:15.737845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:15.745432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.746206 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.748257 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.748927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.883577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:15.905422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:15.911160 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:15.914253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-63d80802-5c17-4e46-9b45-135993b1ea19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1280 microversion: 2.20 time: 0.492403 Nov 19 15:04:15.914881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 28/58] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:15 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:15.927031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:15.928544 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:15.937475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.938261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:15.940044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:15.941006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:16.045998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:16.058626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-03c2a65c-32da-4716-ad44-45c08f9f2c1b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.327035 Nov 19 15:04:16.075136 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:15 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:16.113027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:16.130712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6335dbc0-c8da-4777-a0dc-324f0bc51900 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.213904 Nov 19 15:04:16.131416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:15 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:16.218271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-90b54012-6b2e-4d31-bf1a-a5738180709b req-12d37f7e-b174-4c8e-9cf3-643b33053c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d137ea7-786a-4fb3-bb1f-95d526175a90", "tag": "94209437-90e5-4185-8bfb-c299b5e4e597"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:16.220663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:16.220663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:16.230040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-90b54012-6b2e-4d31-bf1a-a5738180709b req-12d37f7e-b174-4c8e-9cf3-643b33053c9f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:16.231015 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-90b54012-6b2e-4d31-bf1a-a5738180709b req-12d37f7e-b174-4c8e-9cf3-643b33053c9f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:16.263862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-90b54012-6b2e-4d31-bf1a-a5738180709b req-12d37f7e-b174-4c8e-9cf3-643b33053c9f service nova] Creating event network-changed:94209437-90e5-4185-8bfb-c299b5e4e597 for instance 5d137ea7-786a-4fb3-bb1f-95d526175a90 on hv-cinder-81757 Nov 19 15:04:16.277795 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-90b54012-6b2e-4d31-bf1a-a5738180709b req-12d37f7e-b174-4c8e-9cf3-643b33053c9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163063 Nov 19 15:04:16.279442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 32/61] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:16.315069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:16.315684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:16.322396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:16.322850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:16.323633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:16.324072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:16.478654 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:16.486237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-48fdb5c4-fe91-48bb-bb71-1eca6881f624 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.175452 Nov 19 15:04:16.486906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:16 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:16.933581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:16.934451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:16.941399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:16.942126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:16.943193 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:16.944034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.024027 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.034068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.035954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.037437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a691077a-05ff-4ea9-80ed-a2a7420095c8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.108055 Nov 19 15:04:17.038046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 33/63] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:16 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:17.082692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:17.084224 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:17.090949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.091642 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.092443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.093067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.150844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:17.153110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:17.165895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.169594 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.170815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.173247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.272221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.273895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.282442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d5e26447-371c-4806-990f-38f3f467b46f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.137800 Nov 19 15:04:17.284391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:17 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:17.285341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d78285b6-f617-4797-8ccd-a0cf365316c1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.207349 Nov 19 15:04:17.286128 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:17 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:17.503668 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:17.504515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:17.511457 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.512183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.513201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:17.513814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:17.711423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:17.719985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-69713f00-adcb-45c2-94e5-9770f26257ae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.220967 Nov 19 15:04:17.721421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:17 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:18.056560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:18.057199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:18.066406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.067996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.069591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.070238 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.154564 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.171248 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.174604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.176004 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-daa77436-cae0-4fe4-b501-90ce719acc9a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.124180 Nov 19 15:04:18.176740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 32/67] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:18 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:18.307462 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:18.308731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:18.310822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:18.311990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:18.321475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.321907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.322895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.323340 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.323879 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.324557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.325581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.326222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.444947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.466463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bc267ec4-0829-42c5-88e6-f3b94d45185c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.163323 Nov 19 15:04:18.468240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:18 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:18.513583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.522226 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b41bf4ce-efcb-4cf7-822a-0ead30b9f4fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.224089 Nov 19 15:04:18.522730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:18 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:18.738048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:18.738722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:18.747970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.748420 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.749258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:18.749712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:18.926562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:18.937026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-02ebb534-042a-4cda-b319-4980a105cb5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.202693 Nov 19 15:04:18.937775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 37/70] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:18 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:19.194246 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:19.196351 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:19.202662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.205653 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.206778 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.207458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.294022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:19.321823 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:19.325971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:19.330105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3592063a-05aa-47de-a66f-0cda026d4e29 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.138309 Nov 19 15:04:19.343308 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 34/71] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:19 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:19.494913 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:19.495568 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:19.502122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.503276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.504542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.505267 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.541568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:19.542343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:19.560705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.562483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.563326 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.565699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.592741 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:19.601480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-accc9f9f-6dbc-4238-9ef6-f8340babff66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.119622 Nov 19 15:04:19.602491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:19 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:19.879537 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:19.888583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0a81cd8-1041-4b5b-b6e9-a52072f312fb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.352153 Nov 19 15:04:19.889384 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 35/73] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:19 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:19.955479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:19.955799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:19.963847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.964558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:19.965802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:19.966392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.141893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:20.150020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e2036719-41de-4ea6-8353-1eb80c6de8dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.198742 Nov 19 15:04:20.150837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:19 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:20.351698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:20.352423 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:20.358742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.359059 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.359835 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.360270 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.463290 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:20.474113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:20.475488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:20.476631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbb6be3d-afed-42f1-a6da-8dc13854ab19 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.128849 Nov 19 15:04:20.477214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 36/75] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:20 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:20.619434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:20.620693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:20.627681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.628713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.629904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.630494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.704073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:20.719046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9710fcdb-1c4a-4b1a-86b0-ea8f07e4248b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.101796 Nov 19 15:04:20.726016 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 40/76] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:20 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:20.905475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:20.906277 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:20.912621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.913176 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:20.914028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:20.914464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.085074 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.094793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4e9c003b-7b13-4442-b4a2-5cc788008531 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.191645 Nov 19 15:04:21.104471 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 37/77] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:20 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:21.184551 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:21.185611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:21.193484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.194175 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.196265 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.196512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.382511 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.390640 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-17d24de2-f378-49ed-9f20-1fbbd08dc2fa tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.215197 Nov 19 15:04:21.391194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 41/78] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:21 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:21.496228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:21.496625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:21.503162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.503908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.504438 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.504903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.573256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.582298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.583896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.585827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4d86f0c4-d746-4df6-a60a-87c49f77cb36 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.093083 Nov 19 15:04:21.589712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 38/79] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:21 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:21.743892 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:21.744404 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:21.750403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.750853 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.751836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:21.752329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:21.822976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:21.830784 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cb399eca-3168-46ff-b862-edce78b33d77 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.092260 Nov 19 15:04:21.831356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 42/80] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:21 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:22.118798 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:22.119417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:22.125725 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.126167 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.127049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.127481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.271717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.281631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3444d054-a8cf-493c-b9e2-cb56b6dd23cf tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.173503 Nov 19 15:04:22.282216 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 39/81] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:22 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:22.406448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:22.407051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:22.413395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.413837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.414607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.415035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.566575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.574240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-15372f19-6b41-42dc-acb9-8cf8de11b96a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.171253 Nov 19 15:04:22.574808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 43/82] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:22 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:22.610443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:22.612038 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:22.622347 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.622347 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.623069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.623517 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.711440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.719573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.721177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.722281 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-098d4f00-f443-43e3-af1d-cde0f5fb80b9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.119241 Nov 19 15:04:22.722838 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 40/83] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:22 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:22.848837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:22.850995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:22.857462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.857906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.858686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:22.859117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:22.931619 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:22.944657 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ea44e24f-c3a1-4998-b134-b453a6d424b8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1273 microversion: 2.1 time: 0.099434 Nov 19 15:04:22.945631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 44/84] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:22 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:23.300375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:23.301024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:23.307895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.308348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.309354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.309796 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.520044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:23.527403 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6aa9970c-80ed-4b39-977f-e10305208a53 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.231866 Nov 19 15:04:23.538015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 41/85] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:23 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:23.591819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:23.592526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:23.599360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.599830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.600614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.601072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.746851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:23.748777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:23.749998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:23.754456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ab5a5436-f6e9-4380-9655-eb43db17e890 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.166478 Nov 19 15:04:23.756522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 45/86] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:23 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:23.785435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.785898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.786767 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.787357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.911183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:23.925933 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:23.935527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:23.938165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28396ff5-5321-444d-8371-5f4225d1da75 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1284 microversion: 2.20 time: 0.199668 Nov 19 15:04:23.939266 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 42/87] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:23 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:23.962887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:23.964103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:23.972702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.973569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:23.974797 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:23.975726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:24.075714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:24.096830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-91cb6fb2-3dec-464b-b16a-97419e85631c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1281 microversion: 2.1 time: 0.137862 Nov 19 15:04:24.102606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 46/88] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:23 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:24.545259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:24.545869 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:24.557129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:24.558114 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:24.559521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:24.560236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:24.779145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:24.780030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:24.787727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:24.789048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:24.790381 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:24.791232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:25.152106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.175241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.184407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c37c9f38-c886-47f9-a3f6-1ac8ade2306b tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.626693 Nov 19 15:04:25.185042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 43/89] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:24 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:25.194776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1f60b57d-86cd-48d8-a8e2-caeb869e4782 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.418210 Nov 19 15:04:25.200346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 47/90] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:24 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:25.223567 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:25.224853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:25.226987 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:25.228110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:25.240995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:25.242852 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:25.245103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:25.245382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:25.246058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:25.247873 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:25.248060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:25.250026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:25.445521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.455276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.462013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.466769 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-556a7598-aef9-4247-bf65-7835a89be729 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1279 microversion: 2.1 time: 0.253591 Nov 19 15:04:25.468370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:25.472214 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 48/91] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:25 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:25.479234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37b652cb-c29e-4510-baf4-ac89b3304928 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1338 microversion: 2.20 time: 0.292684 Nov 19 15:04:25.479461 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 44/92] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:25 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:26.059996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-86b01b56-cf58-4555-a8dd-02eba23532f6 req-e4611a07-487e-4ac3-8470-4b4d3d01d604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d257632a-adba-4ac6-8dd4-1be8485c24a7", "tag": "24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:26.062128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:26.062128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:26.070746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-86b01b56-cf58-4555-a8dd-02eba23532f6 req-e4611a07-487e-4ac3-8470-4b4d3d01d604 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.071692 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-86b01b56-cf58-4555-a8dd-02eba23532f6 req-e4611a07-487e-4ac3-8470-4b4d3d01d604 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.087890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-86b01b56-cf58-4555-a8dd-02eba23532f6 req-e4611a07-487e-4ac3-8470-4b4d3d01d604 service nova] Creating event network-changed:24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4 for instance d257632a-adba-4ac6-8dd4-1be8485c24a7 on hv-cinder-81757 Nov 19 15:04:26.093764 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-86b01b56-cf58-4555-a8dd-02eba23532f6 req-e4611a07-487e-4ac3-8470-4b4d3d01d604 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038270 Nov 19 15:04:26.094555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 49/93] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:26.203533 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:26.205262 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:26.212645 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.221791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.224618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.225394 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.226591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:26.227330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:26.234112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.234569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.235358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.236410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.387506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.395661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1c7fb968-aec4-497d-9e04-47fc41f10056 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.181755 Nov 19 15:04:26.396218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 50/94] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:26 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:26.478513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.488950 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c06a7411-745a-4bf6-9ae0-ca346e1a37f0 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.290847 Nov 19 15:04:26.489528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 45/95] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:26 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:26.504925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:26.512324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:26.512552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:26.513409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:26.519072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.519518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.519918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.520494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.520712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.520966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.521986 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:26.522556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:26.709626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.720424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.722613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.723742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3ba53c20-f07a-4cf7-8c67-82e369ed1f86 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.226123 Nov 19 15:04:26.724765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 51/96] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:26 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:26.762829 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:26.771056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-780b8778-568c-4ca1-bda8-500a2b4013dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.267631 Nov 19 15:04:26.771940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 46/97] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:26 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:27.412100 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:27.412851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:27.419024 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.419469 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.420232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.420660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.508297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:27.509010 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:27.514780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.515308 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.516146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.516581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.548993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:27.556408 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9b71d267-65ef-44fd-aaa3-627b035f021c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.147848 Nov 19 15:04:27.556997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 52/98] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:27 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:27.649881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:27.657133 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-33dd3f6e-c7fd-403b-bb75-208abb7667b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.152933 Nov 19 15:04:27.657840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:27 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:27.742367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:27.743081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:27.749054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.749451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.750225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.750656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.787145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:27.787743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:27.793750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.794226 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.795003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:27.795437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:27.931210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:27.938894 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4ffddb0f-aab5-4247-ab1d-a553749de331 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.155253 Nov 19 15:04:27.939475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:27 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:28.029392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:28.038185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:28.039662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:28.040767 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5e01fb4b-87ad-4588-8964-7158f9914379 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.302130 Nov 19 15:04:28.041339 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 53/101] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:27 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:28.573224 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:28.573826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:28.580071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.580510 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:28.581297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.581729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:28.673661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:28.674274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:28.679952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.680398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:28.681201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.681629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:28.714217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:28.723369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eae4d644-754d-47b8-b02e-7752f70e927d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.153610 Nov 19 15:04:28.723942 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 49/102] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:28 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:28.953328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:28.955527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:28.956128 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:28.961000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c06a214e-11af-4037-bff6-222c51edcba6 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.290867 Nov 19 15:04:28.961571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 54/103] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:28 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:28.962138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.962681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:28.963577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:28.964115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.058736 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:29.059394 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:29.065449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.065911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.066688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.067220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.198647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:29.206917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:29.208404 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:29.209545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d7fcd343-5dad-4810-9149-c41095938c9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.154669 Nov 19 15:04:29.210073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 55/104] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:29 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:29.449615 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:29.457665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-850dac9d-465c-4ea3-896a-fcd464e87640 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.506104 Nov 19 15:04:29.458319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 50/105] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:28 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:29.745691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:29.748052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:29.755657 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.757324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.758377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.759014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.906253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:29.914695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d6e3b3a4-b7d5-4647-9173-ceef164d2cae tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.176540 Nov 19 15:04:29.915261 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 56/106] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:29 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:29.978880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:29.979487 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:29.985623 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.985925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:29.986641 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:29.987071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.007895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-56116434-a0ac-47f1-b08e-09d0d07abe10 req-abf856e2-a61f-40e9-b199-d6ebdfa250e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffd2431-3834-482a-b5b7-872064a1058a", "tag": "b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:30.009945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:30.009945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:30.020963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-56116434-a0ac-47f1-b08e-09d0d07abe10 req-abf856e2-a61f-40e9-b199-d6ebdfa250e1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.021686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-56116434-a0ac-47f1-b08e-09d0d07abe10 req-abf856e2-a61f-40e9-b199-d6ebdfa250e1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.037311 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-56116434-a0ac-47f1-b08e-09d0d07abe10 req-abf856e2-a61f-40e9-b199-d6ebdfa250e1 service nova] Creating event network-changed:b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c for instance 1ffd2431-3834-482a-b5b7-872064a1058a on hv-cinder-81757 Nov 19 15:04:30.042530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-56116434-a0ac-47f1-b08e-09d0d07abe10 req-abf856e2-a61f-40e9-b199-d6ebdfa250e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Nov 19 15:04:30.043742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 57/107] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:30.187094 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:30.195138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b9c333b-04ec-48e3-8e15-8bcc9d9704d1 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.219924 Nov 19 15:04:30.195700 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 51/108] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:29 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:30.229282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:30.229917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:30.236181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.236625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.237461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.237900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.372617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:30.381471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:30.383031 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:30.384383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-82c6f80d-095c-4699-8df8-4f2a8aba041f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.159042 Nov 19 15:04:30.384957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 58/109] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:30 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:30.474818 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:30.475417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:30.481470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.481864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.482638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.483077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.613354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:30.620529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e904b252-b97f-41a8-b39a-5df7bad99252 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.149352 Nov 19 15:04:30.621121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 52/110] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:30 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:30.931083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:30.931696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:30.937586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.938035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:30.938945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:30.939387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.069129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.076280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7ef681ef-ea2e-4643-b33a-0f95ec520d9f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.148814 Nov 19 15:04:31.076858 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 59/111] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:30 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:31.213406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:31.214045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:31.220578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.221054 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.221824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.222259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.403105 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:31.404004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:31.411189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.411633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.412424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.412889 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.518418 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.525616 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b5931b06-f350-4c45-b7c5-9fd8bdc973ca tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.315830 Nov 19 15:04:31.526206 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 53/112] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:31 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:31.550622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.558305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.559798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.560908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2ce8013f-7979-4290-a3b6-2f635cd5d487 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.161502 Nov 19 15:04:31.561462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 60/113] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:31 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:31.636824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:31.637426 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:31.643785 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.644233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.645045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:31.645484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:31.773054 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:31.780139 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e355a22-ee4b-4cee-8842-5be5ee8e6a6b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.146854 Nov 19 15:04:31.780686 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 54/114] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:31 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:32.062871 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-b7225cdf-45d8-4b5b-8500-3a15894b714f req-14e6333d-97b4-49fa-9066-364cb90d2989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:32.065045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:32.065045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:32.071824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-b7225cdf-45d8-4b5b-8500-3a15894b714f req-14e6333d-97b4-49fa-9066-364cb90d2989 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.072268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-b7225cdf-45d8-4b5b-8500-3a15894b714f req-14e6333d-97b4-49fa-9066-364cb90d2989 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.082482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-b7225cdf-45d8-4b5b-8500-3a15894b714f req-14e6333d-97b4-49fa-9066-364cb90d2989 service nova] Creating event network-changed:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:04:32.087157 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-b7225cdf-45d8-4b5b-8500-3a15894b714f req-14e6333d-97b4-49fa-9066-364cb90d2989 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027859 Nov 19 15:04:32.087714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 61/115] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:32.093142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:32.093752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:32.099975 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.100421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.101232 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.101695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.543316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:32.544294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:32.551191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.551645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.552449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.552921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.581729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.589282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ea3c39b-7a11-4761-8e54-f5f47705f31c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.499946 Nov 19 15:04:32.600335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 55/116] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:32 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:32.600335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:32.600335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:32.603016 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.603476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.604272 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.604712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.691092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.698244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-52754be1-80e5-4d02-8631-4bc46da0d44c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.158970 Nov 19 15:04:32.698803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 62/117] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:32 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:32.738108 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.746950 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.748444 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.749628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-413b0864-c2d7-43a7-b013-be46f35cdadc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.157876 Nov 19 15:04:32.750140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 56/118] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:32 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:32.797838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:32.798458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:32.804167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.804610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.805434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:32.808770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:32.940936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:32.947990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-179b7d47-f4d8-4274-9fe1-b5c9bfd1ffba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.154871 Nov 19 15:04:32.948561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 63/119] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:32 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:33.607205 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:33.607813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:33.614282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.614730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.615505 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.615940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.714533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:33.715138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:33.721534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.721986 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.722775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.723213 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.741962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:33.749972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c059b1e3-a826-433b-881a-fefc659d7a73 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.146333 Nov 19 15:04:33.750555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 57/120] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:33 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:33.766999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:33.767917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:33.773761 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.774216 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.775000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.775437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.857110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:33.865049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-979f4824-5190-4bf1-85c5-b7db52785040 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.154082 Nov 19 15:04:33.865608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 64/121] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:33 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:33.909505 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:33.917360 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:33.918853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:33.919952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6b025c14-5689-4624-9f76-4c4f0a8d67eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.156702 Nov 19 15:04:33.920495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 58/122] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:33 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:33.965526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:33.966127 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:33.972296 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.972739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:33.973523 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:33.973955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.103127 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:34.111036 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-37bf3da7-fb57-4d3a-86b7-dd5acadf51b3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.148609 Nov 19 15:04:34.111634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 65/123] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:33 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:34.767923 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:34.768531 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:34.774449 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.774897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.775676 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.776110 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.881857 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:34.882561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:34.888263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.888706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.889507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.889933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.902336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:34.909721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8f1c9091-982d-47ac-812b-e2800ed17c84 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.146175 Nov 19 15:04:34.910280 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 59/124] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:34 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:34.939002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:34.939704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:34.946061 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.946512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:34.947329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:34.947894 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:35.025800 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:35.033099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-913c418a-55e8-4ae6-824d-af4aa097680e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.154790 Nov 19 15:04:35.033662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 66/125] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:34 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:35.080714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:35.088430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:35.089951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:35.091296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e8f8f46a-cc27-4a35-a20f-35e4e2d230ac tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.156570 Nov 19 15:04:35.091854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 60/126] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:34 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:35.127809 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:35.128338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:35.134205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:35.134656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:35.135417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:35.135845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:35.264447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:35.271554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b7b9a662-10e8-4ff2-b3ee-5dcef8217d10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.148143 Nov 19 15:04:35.272130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 67/127] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:35 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:35.926219 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:35.926864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:35.932678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:35.933369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:35.933941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:35.934386 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.051047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:36.051696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:36.057896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.058343 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.059126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.059564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.207507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.215130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-209aa66e-3e81-49f7-95ca-e8f5c806aac5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.168420 Nov 19 15:04:36.215972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 68/128] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:36 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:36.220748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:36.221598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:36.227714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.228169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.229002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.229439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.370355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.379450 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.381468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.383004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0114892f-0b79-4ac0-80f1-df2357767931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.165833 Nov 19 15:04:36.394313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 69/129] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:36 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:36.399531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:36.400340 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:36.409316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.409591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.410607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:36.411042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:36.558121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.561527 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:36.566040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ee388fa9-1044-4806-832c-5f9b5a49e763 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.643923 Nov 19 15:04:36.566932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 61/130] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:35 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:36.578557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-44527893-85bf-40a8-bb7e-cc4d4718dfd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.182400 Nov 19 15:04:36.579676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 70/131] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:36 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:37.232618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:37.233297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:37.240408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.240891 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.241662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.242089 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.377748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.385527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67c89964-e662-4b3b-a9ba-dd16cb755eec tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.156664 Nov 19 15:04:37.386087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 62/132] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:37 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:37.401357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:37.402060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:37.408130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.408576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.409361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.409787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.544043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.552471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.553990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.555076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fce834e5-c21e-442d-9b85-e29f72d4d55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.157386 Nov 19 15:04:37.555635 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 71/133] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:37 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:37.582864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:37.583392 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:37.589986 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.591109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.591629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.591966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.596413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:37.598006 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:37.602817 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.603262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.604033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:37.604459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:37.734811 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.746884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-985d73da-45e7-404b-b438-4f256902e0dc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.167069 Nov 19 15:04:37.746980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 63/134] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:37 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:37.762605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:37.770259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3d87d8bb-fe3f-4a9b-9ac1-59b0236ff2dd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.177584 Nov 19 15:04:37.770815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 72/135] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:37 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:38.405396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:38.406011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:38.412850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.413294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.414359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.415024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.573401 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:38.574736 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:38.580943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.581930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.582743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.583184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.584470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.595687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95cc3f01-7a0a-4b58-84f6-faa6e69119de tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.192927 Nov 19 15:04:38.597086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 64/136] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:38 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:38.737807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.753156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.755481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.765058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ae9cc30a-5755-49bd-aab3-33cb694549a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.194846 Nov 19 15:04:38.765472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:38.765865 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 73/137] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:38 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:38.767441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:38.775471 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.776169 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.777176 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.777844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.791867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:38.792588 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:38.799738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.800471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.801512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:38.802729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:38.943995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.951927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7739e8c-cc1d-463a-b2ec-d9c6ea747ee3 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.191172 Nov 19 15:04:38.952493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 65/138] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:38 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:38.962633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:38.970392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2797513e-7697-4451-a76b-b997d74b3bbc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.182672 Nov 19 15:04:38.970948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 74/139] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:38 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:39.612893 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:39.613531 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:39.619297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.619742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.620508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.620965 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.764530 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:39.771954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8dc798eb-9e38-4285-86ee-6490b247db89 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.163235 Nov 19 15:04:39.772515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 66/140] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:39 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:39.782154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:39.783142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:39.789459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.789977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.790830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.791997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.923178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:39.931098 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:39.932600 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:39.933801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-651a6b67-c430-4d5e-92d4-9a78ea0cfb9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.155344 Nov 19 15:04:39.934482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 75/141] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:39 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:39.968856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:39.969597 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:39.975666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.976185 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.976998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.977430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.987239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:39.987975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:39.994515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.995062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:39.995928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:39.996499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:40.131895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:40.139629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-774cdb76-10a2-436e-a10d-9cd00f74fc43 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.174739 Nov 19 15:04:40.140238 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 67/142] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:39 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:40.176149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:40.183365 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-48a3dde8-f79d-4b63-b560-5e1cc6a9048d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.200105 Nov 19 15:04:40.183923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 76/143] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:39 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:40.794977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:40.795603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:40.802538 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:40.802987 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:40.803764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:40.804200 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:40.936839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:40.944153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba2253f5-32f4-46a4-b7f8-5412a7e1bfc9 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.158075 Nov 19 15:04:40.944710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 68/144] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:40 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:40.952939 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:40.953788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:40.959667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:40.960112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:40.960901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:40.961333 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.098462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:41.107097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:41.108925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:41.110172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3213b91b-7a9e-40fd-ade8-6d3caa972b6d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.160853 Nov 19 15:04:41.110965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 77/145] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:40 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:41.158217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:41.158817 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:41.165071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.165926 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.166752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.167265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.201461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:41.205603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:41.215756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.216855 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.217843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.218472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.372465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:41.387550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc908f4a-2d44-4d9c-a8da-290a39b53e47 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.228848 Nov 19 15:04:41.388497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 69/146] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:41 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:41.399308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:41.409353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2def08c2-4f26-4e93-b031-d826969d72a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.211321 Nov 19 15:04:41.414505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 78/147] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:41 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:41.962166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:41.962777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:41.975255 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.977929 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:41.981582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:41.983542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.132020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:42.132988 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:42.144029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.144926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.146025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.146738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.155766 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.167714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a2ad114-ca70-4b4a-8787-ac3208415796 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.209861 Nov 19 15:04:42.169113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 70/148] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:41 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:42.305228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.313926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.315424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.316640 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dd2a9e24-1e33-4be2-9ce6-0314958e248a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.188370 Nov 19 15:04:42.317265 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 79/149] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:42 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:42.404988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:42.405515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:42.412582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.413087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.413943 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.414562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.429211 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:42.429822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:42.436576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.437496 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.438543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:42.439167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:42.595111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.603772 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b2a5946-7249-49ff-a3ed-a7faff56e8b1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.202290 Nov 19 15:04:42.605145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 71/150] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:42 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:42.634316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:42.642421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-99926d12-0949-4ce4-a6fe-5cde05e97590 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.216842 Nov 19 15:04:42.643001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 80/151] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:42 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:43.188005 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:43.188734 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:43.195477 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.196149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.197379 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.197776 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.334545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:43.335153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:43.343753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.345546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.346529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.347171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.438028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.457353 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc776134-44ca-4769-9edf-14f3d53ca7e2 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.275337 Nov 19 15:04:43.461898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 72/152] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:43 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:43.561758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.571750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.573993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.575412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-59110d1f-539b-4b0a-b1be-80a8ccefcbcc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.244806 Nov 19 15:04:43.576250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 81/153] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:43 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:43.623204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:43.624113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:43.635738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.636251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.637083 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.637519 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.662047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:43.663062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:43.670259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.671039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.677012 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:43.677640 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:43.801326 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.810630 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e901bf00-7762-4375-9688-718c0a0adb75 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.192390 Nov 19 15:04:43.811536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 73/154] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:43 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:43.870904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:43.878969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-730dc65c-c407-45fc-bae6-7fa3bbd57c33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.223262 Nov 19 15:04:43.879532 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 82/155] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:43 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:44.483296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:44.484045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:44.490671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.491111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.491931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.492507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.593978 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:44.596142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:44.604091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.604543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.605590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.606215 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.631520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:44.639880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b1335ac-ab13-45b8-9c52-989b8c0a2240 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.163789 Nov 19 15:04:44.641129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 74/156] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:44 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:44.773245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:44.780836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:44.782608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:44.783726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-377fc57f-dc00-481a-92de-e67b84db566d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.193640 Nov 19 15:04:44.784270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 83/157] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:44 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:44.829976 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:44.830895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:44.842454 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.843201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.844219 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.845250 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.895160 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:44.895764 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:44.901796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.902452 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:44.903231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:44.903667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:45.005017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:45.012404 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-496921f3-e417-4f76-9014-0cdae3ea9d83 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.187183 Nov 19 15:04:45.012950 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 75/158] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:44 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:45.058451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:45.066038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f90a9735-2c0f-4cac-8a95-8d46a94f30aa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.174490 Nov 19 15:04:45.066663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 84/159] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:44 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:45.662338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:45.670299 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:45.683081 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:45.683735 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:45.684666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:45.685295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:45.804315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:45.805586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:45.813161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:45.813851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:45.814832 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:45.816030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:45.877605 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:45.900017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f23feadd-0ad2-4069-8800-92167fa6949c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.243111 Nov 19 15:04:45.900810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 76/160] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:45 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:46.024083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:46.032926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:46.034297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:46.034556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:46.035470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3effbec3-e860-4a1c-baa8-c7fe067c1d4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.237308 Nov 19 15:04:46.035677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:46.040890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 85/161] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:45 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:46.041851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.042291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.043100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.043531 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.082744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:46.083348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:46.108141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.108598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.109625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.110902 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.208304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:46.216364 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5a6b996-effc-47b2-8269-69acdd703e99 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.187412 Nov 19 15:04:46.216971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 77/162] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:46 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:46.259212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:46.267546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c2c50e3d-d788-42ac-89d0-ce6b15d91df4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.188445 Nov 19 15:04:46.267963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 86/163] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:46 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:46.596883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-cd38ac47-109e-470e-81fb-e01c6d9a39bd req-228358dd-ae29-43b5-bc8e-1480913a0ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d257632a-adba-4ac6-8dd4-1be8485c24a7", "name": "network-vif-plugged", "status": "completed", "tag": "24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:46.599105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:46.599105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:04:46.608644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-cd38ac47-109e-470e-81fb-e01c6d9a39bd req-228358dd-ae29-43b5-bc8e-1480913a0ae9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.609116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-cd38ac47-109e-470e-81fb-e01c6d9a39bd req-228358dd-ae29-43b5-bc8e-1480913a0ae9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.629404 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-cd38ac47-109e-470e-81fb-e01c6d9a39bd req-228358dd-ae29-43b5-bc8e-1480913a0ae9 service nova] Creating event network-vif-plugged:24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4 for instance d257632a-adba-4ac6-8dd4-1be8485c24a7 on hv-cinder-81757 Nov 19 15:04:46.629909 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-cd38ac47-109e-470e-81fb-e01c6d9a39bd req-228358dd-ae29-43b5-bc8e-1480913a0ae9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 15:04:46.631032 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.631469 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.632263 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.632895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.642594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.compute.rpcapi [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 15:04:46.643589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] Releasing lock "compute-rpcapi-router" {{(pid=116266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 15:04:46.669314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-01ca66f5-251f-4a5f-a12d-0acdc9ee57b7 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138889 Nov 19 15:04:46.669962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 78/164] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:46.917526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:46.918119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:46.926899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.926899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:46.926899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:46.926899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.057139 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:47.058147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:47.064482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.068826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.069941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.071479 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.072370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.072972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fc98bd29-85cd-41a1-9ae5-8628486adb01 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.158167 Nov 19 15:04:47.073899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 87/165] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:46 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:47.230318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.233991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:47.234607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:47.239291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.241104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.241235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.241573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.242359 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.242790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.242982 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8aee6a81-0897-4b33-90a6-d7027e6c3bff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.189654 Nov 19 15:04:47.244825 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 79/166] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:47 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:47.283550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:47.284190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:47.290442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.290892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.291686 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:47.292116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:47.380214 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.387917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-20b6395a-a4d2-4fb2-9dac-5e844062b60d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.157995 Nov 19 15:04:47.388586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 88/167] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:47 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:47.430921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:47.438185 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-634eddb0-38f5-4588-9fae-41d91bde6ea8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.158592 Nov 19 15:04:47.438748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 80/168] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:47 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:48.090930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:48.092239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:48.107482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.107998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.108833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.109258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.261250 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:48.262021 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:48.269327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.269905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.270618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.271087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.271548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.280365 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8fcaf00e-8aaa-4e40-9b7e-b8406fc649b5 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.193881 Nov 19 15:04:48.281092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 89/169] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:48 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:48.404853 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:48.405694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:48.412176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.412945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.413567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.414232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.486821 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.495478 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.497812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.498993 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-665ac6fa-d78d-4879-8245-d9d710785a13 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.241397 Nov 19 15:04:48.499805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 81/170] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:48 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:48.505644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:48.506243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:48.516632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.517265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.518715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.519530 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.591304 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.607178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-af8d8002-eeb0-4b69-98bb-fdde81f83d5f tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.205929 Nov 19 15:04:48.609443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 90/171] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:48 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:48.686805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:48.697576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-370c13e6-5758-4109-ae5a-2b68c0bd5d33 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.194223 Nov 19 15:04:48.697576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 82/172] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:48 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:48.700142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9389e29-4358-4ddd-9918-0f500d8364f2", "name": "network-vif-plugged", "status": "completed", "tag": "08cbe617-de50-484d-9296-d6a6db7fcc1c"}, {"server_uuid": "5d137ea7-786a-4fb3-bb1f-95d526175a90", "name": "network-vif-plugged", "status": "completed", "tag": "94209437-90e5-4185-8bfb-c299b5e4e597"}, {"server_uuid": "1ffd2431-3834-482a-b5b7-872064a1058a", "name": "network-vif-plugged", "status": "completed", "tag": "b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:48.702025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:48.702025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:48.710243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:48.710801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:48.725737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Creating event network-vif-plugged:08cbe617-de50-484d-9296-d6a6db7fcc1c for instance d9389e29-4358-4ddd-9918-0f500d8364f2 on hv-cinder-81757 Nov 19 15:04:48.726237 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Creating event network-vif-plugged:94209437-90e5-4185-8bfb-c299b5e4e597 for instance 5d137ea7-786a-4fb3-bb1f-95d526175a90 on hv-cinder-81757 Nov 19 15:04:48.726723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] Creating event network-vif-plugged:b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c for instance 1ffd2431-3834-482a-b5b7-872064a1058a on hv-cinder-81757 Nov 19 15:04:48.734755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-3a861fc7-d4dc-4857-bfb2-512375f62398 req-0ce643ac-359c-47bc-a526-8b8d5555e9eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038596 Nov 19 15:04:48.735874 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 91/173] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:48 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:49.297058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:49.298798 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:49.313723 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.317554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.318822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.319511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.533152 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:49.534090 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:49.561611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.562079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.562331 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.563475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.563995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.570466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd7086f6-01f6-432b-ab77-e67b2c994397 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.277403 Nov 19 15:04:49.573171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 83/174] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:49 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:49.624921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:49.626131 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:49.632474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.633123 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.634081 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.634667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.733462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.742174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.743834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.744993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-eb6301af-7002-4fcb-9f38-61e3d5f40095 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.230407 Nov 19 15:04:49.745588 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 92/175] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:49 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:49.750174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:49.750838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:49.756746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.757349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.758656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:49.758656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:49.775952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.783994 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cff9e643-7439-485a-b3a6-429c8304317a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.162674 Nov 19 15:04:49.784559 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 84/176] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:49 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:49.887815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:49.895823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-50d38fd6-0d80-482c-8c7d-3f30cd05b497 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.149211 Nov 19 15:04:49.896387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 93/177] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:49 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:50.589772 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:50.590669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:50.597121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.597572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.598354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.598789 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.732966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:50.741028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85193cb9-5d75-40e9-b560-835868aaf193 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.154939 Nov 19 15:04:50.741902 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 85/178] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:50 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:50.750632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-65f6be1f-ad60-45ab-b022-3d5d14cd103a req-3de7703c-cd8c-49f4-9985-ec68c905462d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "name": "network-vif-plugged", "status": "completed", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:50.752475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:50.752475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:50.760126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-65f6be1f-ad60-45ab-b022-3d5d14cd103a req-3de7703c-cd8c-49f4-9985-ec68c905462d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.760839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-65f6be1f-ad60-45ab-b022-3d5d14cd103a req-3de7703c-cd8c-49f4-9985-ec68c905462d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.763813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:50.764550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:50.772457 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.773199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.773786 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-65f6be1f-ad60-45ab-b022-3d5d14cd103a req-3de7703c-cd8c-49f4-9985-ec68c905462d service nova] Creating event network-vif-plugged:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:04:50.773996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.774429 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.779357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-65f6be1f-ad60-45ab-b022-3d5d14cd103a req-3de7703c-cd8c-49f4-9985-ec68c905462d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Nov 19 15:04:50.780292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 94/179] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:04:50.839417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:50.840504 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:50.847411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.847928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.848774 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.849295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.903295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:50.912045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:50.913574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:50.914674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4bb12c99-58ef-460a-95ad-2df7bca1cbee tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.154708 Nov 19 15:04:50.915231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 86/180] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:50 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:50.919481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:50.920071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:50.925987 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.926435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.927243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:50.927674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:50.982204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:50.990238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-482ca8bd-34df-4c3c-8312-cd316ee16b81 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.154706 Nov 19 15:04:50.990844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 95/181] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:50 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:51.055013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:51.062467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc4cf355-5978-4c3f-b16f-e114b1824512 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.146266 Nov 19 15:04:51.063069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 87/182] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:50 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:51.797690 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:51.798598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:51.804485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:51.804963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:51.805760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:51.806195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:51.931472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:51.931921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:51.932084 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:51.938017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:51.938466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:51.938980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-03d28403-a4cb-4c17-87eb-bf4e83bd6c71 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.145315 Nov 19 15:04:51.939338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:51.939538 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 96/183] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:51 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:51.939777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.006747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:52.007341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:52.013314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.013770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.014559 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.015059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.070690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:52.078881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:52.080365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:52.081698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cf385c9c-ba7e-430d-9d13-9d3c9bd463ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.153873 Nov 19 15:04:52.082407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 88/184] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:51 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:52.087145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:52.087943 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:52.094961 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.095489 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.096289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.096828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.157296 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:52.164658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b67d08ee-8a0f-4265-aedb-4a6cc690b417 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.161518 Nov 19 15:04:52.165258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 97/185] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:52 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:52.224766 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:52.232165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5762758-d38f-4756-81ec-f022153c20f7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.148963 Nov 19 15:04:52.232729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 89/186] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:52 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:52.956270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:52.956908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:52.963416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.963876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:52.964688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:52.965415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.101330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:53.102119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:53.109997 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.110788 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.112043 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.112585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.129140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.136746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5c672b93-19e5-4f21-a2b0-4ca0aea5020e tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.184462 Nov 19 15:04:53.139717 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:52 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:53.182730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:53.182730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:53.188891 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.189434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.190318 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.190860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.264861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.277402 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.279109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.280247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0638e5de-b2c7-464a-9548-c039e335d4ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.183673 Nov 19 15:04:53.280818 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 90/188] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:53 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:04:53.285859 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:53.286460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:53.292555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.293033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.293812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:53.294247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:53.336175 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.343759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-81082b76-8bb4-412e-9450-4a56b9b720df tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.165360 Nov 19 15:04:53.345100 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 99/189] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:53 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:53.450309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:53.458980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-441a6a21-32cd-4a79-a773-f80eef70d27d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1321 microversion: 2.1 time: 0.177138 Nov 19 15:04:53.459573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 91/190] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:53 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:54.157504 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:54.158189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.164089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.164539 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.165434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.165931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.293949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.299177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:54.299846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.302461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1845152c-54ee-46f2-b3ce-52e59edbdc47 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1314 microversion: 2.1 time: 0.149680 Nov 19 15:04:54.303033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:54 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:54.305617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.306058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.306831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.307261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.363086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:54.363703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.369950 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.370399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.371198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.371776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.443844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.452253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.454179 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.455568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb1687c9-80c9-4760-9c7f-aba91f51a470 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1405 microversion: 2.20 time: 0.160731 Nov 19 15:04:54.466339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 92/192] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:54 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:54.478998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:54.479716 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.486492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.487028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.487933 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.488370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.520710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.528068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-357914b8-12cf-44b6-8770-54060f0fc8e5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1317 microversion: 2.1 time: 0.169530 Nov 19 15:04:54.538013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 101/193] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:54 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:54.639029 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:54.647858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e53eed96-2282-4c55-8a3f-c9d4c9b76395 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1515 microversion: 2.1 time: 0.174152 Nov 19 15:04:54.648430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 93/194] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:54 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:04:54.665815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:54.666801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.672570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.673196 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.673976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.674410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.736030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'flavor' on Instance uuid 1ffd2431-3834-482a-b5b7-872064a1058a {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:04:54.881428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c587cd4d-1109-44fe-bf1a-86316a86636e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a/action" status: 200 len: 32 microversion: 2.1 time: 0.218809 Nov 19 15:04:54.886072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 102/195] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:04:54 2021] POST /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:04:54.893068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:54.894112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:54.902573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.903210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:54.904352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:54.904966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.325560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:55.326341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:55.336681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.337825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.340751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.341617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.368513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.376967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6d92848e-d0f8-4195-9110-61f143585445 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.489195 Nov 19 15:04:55.377535 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 94/196] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:54 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:55.473803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:55.474866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:55.481529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.482203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.483151 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.483732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.524883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.533646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9ba2ce65-9f9d-4601-8a0b-368241d8e743 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1501 microversion: 2.1 time: 0.216307 Nov 19 15:04:55.534804 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 103/197] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:55 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:55.552759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:55.553609 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:55.560474 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.561087 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.562069 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.562605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.697110 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.709793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.711476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.712951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fa4d6136-62cc-4b9b-93a8-5009d4f809e0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1597 microversion: 2.20 time: 0.243161 Nov 19 15:04:55.713738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 95/198] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:04:55 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1597 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:04:55.733745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:55.734501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:55.758379 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.761637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.763497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:55.763657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:55.764056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:55.773361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-68cb5367-6704-409e-900a-75e42ad1459d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1508 microversion: 2.1 time: 0.229717 Nov 19 15:04:55.774716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:55 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:56.042089 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95bbebac-a8e3-4caa-b966-df2740f5aa61 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.312622 Nov 19 15:04:56.043072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 96/200] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Nov 19 15:04:55 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:04:56.396297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:56.397645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:56.405240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:56.405999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:56.407971 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:56.408595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:56.897519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:56.910306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-264a348a-6301-4531-b930-e726fee7ff8e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.518569 Nov 19 15:04:56.910888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 105/201] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:56 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:57.092369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d5b0197-644a-4bb1-bdf1-34c284a65624"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:57.095972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:57.114046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.116724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:57.117864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.119289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:57.322725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68107d4c-e27a-44ec-bdec-8e6266441350"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:57.324510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:57.334132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.334555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:57.336595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.337059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:57.574827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b6fe0d2-23c7-4048-9611-6083486b90ea tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "POST /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492229 Nov 19 15:04:57.583352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 97/202] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:04:57 2021] POST /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:57.929901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:57.930606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:57.946408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.946408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:57.946759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:57.947378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:58.043146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dfb9b308-5e38-41c2-9ada-15334e731c95 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722583 Nov 19 15:04:58.049959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 106/203] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:04:57 2021] POST /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:04:58.056298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:58.057440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:58.065134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:58.065712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:58.066562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:58.067066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:58.162442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-907e2bc9-b8f4-423f-91df-3335a97c176f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.110603 Nov 19 15:04:58.164123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 107/204] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:04:58 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:58.171140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-05e454f7-a15d-4141-b86c-a10925dd2764 req-ed113280-7a8d-4a87-b8fe-4fb6483e75d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:58.178427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:04:58.178427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:04:58.198661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-05e454f7-a15d-4141-b86c-a10925dd2764 req-ed113280-7a8d-4a87-b8fe-4fb6483e75d4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:58.199393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-05e454f7-a15d-4141-b86c-a10925dd2764 req-ed113280-7a8d-4a87-b8fe-4fb6483e75d4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:58.225012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:58.236521 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-05e454f7-a15d-4141-b86c-a10925dd2764 req-ed113280-7a8d-4a87-b8fe-4fb6483e75d4 service nova] Creating event network-changed:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:04:58.238318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d8634b5d-29af-42f3-a5f6-b66d6cb31eec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.312373 Nov 19 15:04:58.241763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 98/205] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:57 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:58.242801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-05e454f7-a15d-4141-b86c-a10925dd2764 req-ed113280-7a8d-4a87-b8fe-4fb6483e75d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077053 Nov 19 15:04:58.243666 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 108/206] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:04:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:04:59.175442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:04:59.176548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:59.193042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:59.193698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:59.194560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:59.195006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:59.268369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:04:59.269070 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:04:59.279933 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a6922fd7-f021-453d-95a7-8e230ef2a40d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.108764 Nov 19 15:04:59.282012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 99/207] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:04:59 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:04:59.287506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:59.287961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:59.288850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:04:59.289526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:04:59.479736 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:04:59.489651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-97ea4410-98b6-4940-91db-9f3a0dfb96de tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.226580 Nov 19 15:04:59.500192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 109/208] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:04:59 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:00.292941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:00.294112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:00.302828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:00.303287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:00.304088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:00.316952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:00.390307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5f43097-16aa-466e-b36d-21875bce318a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.101319 Nov 19 15:05:00.394260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 100/209] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:00 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:00.507931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:00.508752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:00.515548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:00.516729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:00.518012 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:00.518824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:00.664365 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:00.671765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-98e62af3-22f8-40be-b832-1a0c59d0e5b9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.167863 Nov 19 15:05:00.676655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:00 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:01.402615 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:01.404250 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:01.411531 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:01.412344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:01.413465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:01.414105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:01.494574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1427f17b-fba5-471f-818a-60463c4a8921 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.095944 Nov 19 15:05:01.495208 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 101/211] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:01 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:01.688290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:01.689030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:01.695151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:01.695600 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:01.696387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:01.696848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:01.855931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:01.863824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-da658eed-59b0-40fe-a478-48610dec0a43 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.179044 Nov 19 15:05:01.864387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:01 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:02.506509 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:02.507625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:02.514850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:02.515368 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:02.516695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:02.517260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:02.613039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4725e5e9-39c6-4fb5-9dc0-3c9503784375 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.110421 Nov 19 15:05:02.613665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 102/213] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:02 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:02.881772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:02.882367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:02.888572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:02.889106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:02.890018 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:02.890452 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:03.030109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:03.040431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2c890ff0-50e9-435c-b32e-5d4c86561cd9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.162619 Nov 19 15:05:03.041008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 112/214] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:02 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:03.624114 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:03.625578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:03.632448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:03.633097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:03.633988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:03.634529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:03.735758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0be6a8b3-a387-4b6d-a4c3-934547ee675e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.115303 Nov 19 15:05:03.736399 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 103/215] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:03 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:04.057418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:04.058051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:04.065268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:04.065722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:04.066570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:04.067013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:04.204745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:04.212245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c5fee588-aee8-490d-bf83-cc226cda7bd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.158367 Nov 19 15:05:04.217903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 113/216] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:04 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:04.747111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:04.748276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:04.755802 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:04.756408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:04.759596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:04.760137 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:04.831687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3cb343d-d321-444a-8418-b6e53525b206 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.088436 Nov 19 15:05:04.832458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 104/217] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:04 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:05.233289 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:05.235008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:05.241755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:05.242215 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:05.243131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:05.243429 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:05.378457 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:05.385964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-477c718e-4743-468e-afba-8cc9459e913b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.156384 Nov 19 15:05:05.386535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 114/218] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:05 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:05.843704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:05.845359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:05.852423 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:05.852888 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:05.853661 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:05.854089 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:06.404161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:06.404760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:06.411509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:06.411946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:06.412716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:06.413168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:06.542880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:06.550409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c6119a63-fbdb-44bd-8fd2-7b22fab8acf2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.149834 Nov 19 15:05:06.551074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 115/219] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:06 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:07.567316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:07.567922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:07.574057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:07.574502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:07.575270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:07.575697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:07.704236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:07.711466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b8360773-fc0a-4367-817c-d65b21d95c80 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.147850 Nov 19 15:05:07.711976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 116/220] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:07 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:08.728545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:08.729513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:08.736442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:08.736915 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:08.737713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:08.738151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:08.786215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1430d3ee-8b36-4b0b-b1d7-9d0211688472 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 2.947195 Nov 19 15:05:08.787124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 105/221] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:05 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 2949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:08.874831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:08.882062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-33cd5efd-090b-4305-aa9a-a1d053bdcc61 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.157351 Nov 19 15:05:08.882843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 117/222] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:08 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:09.377911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:09.378515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:09.385885 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.386328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.387102 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.387541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.411393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:05:09.521817 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5fd98c43-4afb-45c3-8035-ee786f0cba54 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 204 len: 0 microversion: 2.1 time: 0.147218 Nov 19 15:05:09.522353 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 106/223] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:05:09 2021] DELETE /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:05:09.537341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:09.537341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:09.542412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.543056 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.543860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.544302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.681862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:09.691720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1a116143-8d60-46ad-b86d-fca12009d04c tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.165006 Nov 19 15:05:09.692569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 118/224] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:09 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:09.797574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:09.799056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:09.805360 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.805809 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.806583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.807017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.899349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:09.899949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:09.906148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.906618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:09.907388 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:09.907813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:10.043898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:10.051252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8a4b56ab-6c2b-4e3b-a186-dfbcd81385a9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.155604 Nov 19 15:05:10.051811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 119/225] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:09 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:10.709014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:10.709621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:10.715832 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:10.716273 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:10.717071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:10.717525 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:11.007848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:11.016113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-33c9cbcd-9a06-482f-9c5c-0e00bf5234cd tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.310159 Nov 19 15:05:11.016663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 120/226] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:10 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:11.068209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:11.068824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:11.074454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:11.074899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:11.075662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:11.076096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:11.204578 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:11.211777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-03f6837a-dde3-4c50-928f-668429619120 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.147015 Nov 19 15:05:11.212369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 121/227] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:11 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:12.033034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:12.033643 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:12.039870 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:12.040316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:12.041131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:12.041565 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:12.170538 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:12.179050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c6ead928-eb75-4771-b1cc-766343cf7e69 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.149949 Nov 19 15:05:12.179620 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 122/228] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:12 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:12.230730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:12.231373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:12.238881 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:12.239332 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:12.240113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:12.240549 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:12.365265 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:12.372394 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f24c69a-0300-4a7b-b8fd-70d17e58ee9f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.146518 Nov 19 15:05:12.372941 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 123/229] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:12 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:12.971778 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3dbacc0e-2622-453f-9129-bbd3ec2aa447 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 3.177970 Nov 19 15:05:12.972407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 107/230] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:09 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 3180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:13.195464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:13.196200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:13.202343 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.202786 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:13.204162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.204591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:13.336597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:13.344591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-41005060-6951-4cfa-8aca-b004acf15475 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.152725 Nov 19 15:05:13.345184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 124/231] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:13 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:13.389602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:13.390300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:13.397141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.397593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:13.398365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.398808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:13.528546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:13.537684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6ed6e5af-594e-484f-9c21-b7bc33b302b4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.151967 Nov 19 15:05:13.538257 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 108/232] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:13 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:13.982401 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:13.983279 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:13.989685 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.990584 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:13.991357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:13.991795 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:14.068200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-da923492-e5ed-40b5-883d-0a24908e999f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.089245 Nov 19 15:05:14.068862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 125/233] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:13 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:14.362142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:14.362745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:14.369702 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:14.370411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:14.371410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:14.371970 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:14.535147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:14.543102 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe4e2d4f-c40e-4dd9-8142-2410ff3f2945 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.185454 Nov 19 15:05:14.544202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 109/234] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:14 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:14.556045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:14.556722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:14.564377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:14.564859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:14.565645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:14.566148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:14.740167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:14.748667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1c2546db-6e94-4016-91f7-69060b3ba19d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.196650 Nov 19 15:05:14.758983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 126/235] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:14 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:15.121231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:15.122206 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:15.129638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.130143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.131050 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.131954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.221975 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a115bea-211b-4bb0-b740-189963416a16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 14 microversion: 2.20 time: 0.107289 Nov 19 15:05:15.222935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 110/236] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:15 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:15.564377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:15.565887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:15.578921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.579751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.581465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.582306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.768055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:15.769274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:15.781912 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.786118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.788193 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.788958 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.790244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:15.803436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e3b73dc0-28ac-4da2-a84a-f2c582848691 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1553 microversion: 2.1 time: 0.245772 Nov 19 15:05:15.804490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 127/237] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:15 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:15.889782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-12bfe2b7-714b-4127-bd4d-aa8e2c90d91f req-373ecf01-5d0d-47ca-b660-5133bbc1a8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9389e29-4358-4ddd-9918-0f500d8364f2", "name": "network-vif-deleted", "tag": "08cbe617-de50-484d-9296-d6a6db7fcc1c"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:15.892414 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:15.892414 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:15.901610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-12bfe2b7-714b-4127-bd4d-aa8e2c90d91f req-373ecf01-5d0d-47ca-b660-5133bbc1a8fd service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:15.903068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-12bfe2b7-714b-4127-bd4d-aa8e2c90d91f req-373ecf01-5d0d-47ca-b660-5133bbc1a8fd service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:15.920010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-12bfe2b7-714b-4127-bd4d-aa8e2c90d91f req-373ecf01-5d0d-47ca-b660-5133bbc1a8fd service nova] Creating event network-vif-deleted:08cbe617-de50-484d-9296-d6a6db7fcc1c for instance d9389e29-4358-4ddd-9918-0f500d8364f2 on hv-cinder-81757 Nov 19 15:05:15.927452 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-12bfe2b7-714b-4127-bd4d-aa8e2c90d91f req-373ecf01-5d0d-47ca-b660-5133bbc1a8fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041793 Nov 19 15:05:15.928109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 128/238] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:05:15.976025 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:15.984785 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-203ba03c-c459-404b-8b37-91edac724e2f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.221765 Nov 19 15:05:15.985596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 111/239] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:15 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:16.235410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:16.240288 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:16.257060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:16.257588 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:16.258492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:16.258943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:16.368699 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-38b1073a-0816-47f9-9e04-0932f2f0c887 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 7294 microversion: 2.20 time: 0.138142 Nov 19 15:05:16.369445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 129/240] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:16 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 7294 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:05:16.822484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:16.823969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:16.830234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:16.830690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:16.832605 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:16.833066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:16.875538 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:16.876286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:16.877578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lazy-loading 'fault' on Instance uuid d9389e29-4358-4ddd-9918-0f500d8364f2 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:05:16.923119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f3c7789b1fd4da9a9a37d75ee40c66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f706bd80a9247579246ab8d0ec2203d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:16.930698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7957edd9-f7ec-4348-8f92-e0003bde9791 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 200 len: 1304 microversion: 2.1 time: 0.113550 Nov 19 15:05:16.931279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 112/241] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:16 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:17.001639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:17.002422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:17.009314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.009837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.010685 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.011125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.147132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:17.154348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1a71fe18-c5d6-41dc-a4d1-ed8a8d47b899 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.156723 Nov 19 15:05:17.154911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 130/242] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:16 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:17.381660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:17.382947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:17.389435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.389675 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.391158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.391594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.947576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:17.948092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:17.954379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.954819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.955581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:17.956008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:17.968951 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] HTTP exception thrown: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. Nov 19 15:05:17.969575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Returning 404 to user: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:05:17.970377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-11af3164-f7ab-4c2c-9074-f9cb3ec82edb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 404 len: 111 microversion: 2.1 time: 0.026881 Nov 19 15:05:17.970884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 131/243] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:17 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:05:18.068153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:18.069092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:18.074869 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:18.075309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:18.076077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:18.076509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:18.088863 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] HTTP exception thrown: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. Nov 19 15:05:18.089429 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Returning 404 to user: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:05:18.090486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fc71d2ca-9450-45d5-860e-e6d61a5da5b4 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026055 Nov 19 15:05:18.090991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 132/244] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:05:18 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2/os-volume_attachments => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:05:18.171556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:18.173063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:18.179102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:18.179553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:18.180333 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:18.180772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:18.316207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:18.323895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1dd3a7cf-9772-4dcc-a956-1115bec42a20 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.155870 Nov 19 15:05:18.324444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 133/245] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:18 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:19.340613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:19.341237 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:19.347490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:19.347946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:19.348727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:19.349230 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:19.479773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:19.487838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ef473cad-a4f9-43ad-8538-84093fb6d874 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.151057 Nov 19 15:05:19.488402 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 134/246] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:19 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:19.820146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bd898bae-ccf7-44af-9c7d-17a458768907 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 16877 microversion: 2.20 time: 2.442771 Nov 19 15:05:19.820779 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 113/247] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:17 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 16877 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:20.504463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:20.505095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:20.511356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:20.511808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:20.512601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:20.513062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:20.647808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:20.655189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0b4e614d-8e07-40e7-986e-986afc218e14 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.154361 Nov 19 15:05:20.657230 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 135/248] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:20 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:20.832773 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:20.835197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:20.844264 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:20.845069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:20.846090 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:20.847009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:20.988256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c977762e-c092-4391-bc71-34ed217b4165 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 17808 microversion: 2.20 time: 0.161041 Nov 19 15:05:20.989675 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 114/249] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:20 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 17808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:21.369363 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:21.369856 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:21.377337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.377803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.378748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.379184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.395109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] HTTP exception thrown: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. Nov 19 15:05:21.395933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Returning 404 to user: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:05:21.396756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ad00589f-2666-47e9-a1da-fa3045088339 tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 404 len: 111 microversion: 2.1 time: 0.031139 Nov 19 15:05:21.397965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 136/250] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:05:21 2021] DELETE /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:05:21.408572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:21.413352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] [instance: d9389e29-4358-4ddd-9918-0f500d8364f2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:21.434190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.434658 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.435952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.436667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.451842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] HTTP exception thrown: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. Nov 19 15:05:21.452465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] Returning 404 to user: Instance d9389e29-4358-4ddd-9918-0f500d8364f2 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:05:21.454465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e93f9e31-3703-4a92-afff-5c9cfd9f5efb tempest-DeleteServersTestJSON-1574325052 tempest-DeleteServersTestJSON-1574325052-project] 10.222.0.20 "GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2" status: 404 len: 111 microversion: 2.1 time: 0.052375 Nov 19 15:05:21.455210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 115/251] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:21 2021] GET /compute/v2.1/servers/d9389e29-4358-4ddd-9918-0f500d8364f2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:05:21.663725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-447088275", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "cd986946-8454-44e7-80e5-6d3c5bfe30eb"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:21.679995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:21.682712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:21.695724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.696946 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.698740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:21.699387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:21.731103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] validate_networks() for [('cd986946-8454-44e7-80e5-6d3c5bfe30eb', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:05:21.852196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:21.860261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11335e18-9649-484c-9e4e-12a97c30baba tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.189764 Nov 19 15:05:21.861039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 116/252] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:21 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:22.000487 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:22.002012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:22.012261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.012780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.013672 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.014198 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.113542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-949ff98d-10e0-4a41-92a0-71603af1f7ce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 19446 microversion: 2.20 time: 0.116688 Nov 19 15:05:22.114687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 117/253] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:21 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 19446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:22.667979 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:05:22.668459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:05:22.669050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:05:22.669509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:05:22.670074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:05:22.680639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.681146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.681962 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.682399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.700575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:22.705177 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for user ba4aff19ddd54325b884984bb6ddc144 and project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:22.719758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:05:22.723362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:05:22.797093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-85d8c993-c324-49f3-8acc-9e6822b1fe09 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137017 Nov 19 15:05:22.798308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 137/254] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:05:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:05:22.810699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7f61c9dd-18c2-4099-99ca-e6f4b6cd8d3a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:22.811671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7f61c9dd-18c2-4099-99ca-e6f4b6cd8d3a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:22.881524 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:22.883025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:22.910766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.911223 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.912393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:22.912854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:22.962119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7f61c9dd-18c2-4099-99ca-e6f4b6cd8d3a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:22.973615 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7f61c9dd-18c2-4099-99ca-e6f4b6cd8d3a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1217 microversion: 2.1 time: 0.168384 Nov 19 15:05:22.974715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 118/255] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:22 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:23.131971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:23.133233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:23.142727 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:23.143503 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:23.144778 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:23.145412 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:23.232386 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-722806cf-ca31-4723-a669-5cfdd2ddcca9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 21834 microversion: 2.20 time: 0.108054 Nov 19 15:05:23.233657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 119/256] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:23 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 21834 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:23.398464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:23.407693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f07a20f7-d34e-409b-aaf5-567de0f1fdd4 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.533515 Nov 19 15:05:23.408418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 138/257] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:22 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:23.992887 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:23.994295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:24.003245 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.003997 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.005186 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.005935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.113344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:24.122320 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca0ab974-f4ee-41c9-9d5b-0b7bd97006ab tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1269 microversion: 2.1 time: 0.134482 Nov 19 15:05:24.123349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 120/258] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:23 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:24.246634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:24.248406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:24.257328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.260305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.263736 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.264245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.385011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-230fa884-555d-42fe-9e0e-d980f227b127 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 23211 microversion: 2.20 time: 0.142787 Nov 19 15:05:24.386333 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 139/259] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:24 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 23211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:24.425536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:24.426939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:24.444883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.445251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.446797 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:24.447420 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:24.704954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:24.722801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cfd525bf-81f4-42c3-9df4-3f2bef3ab90b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.301459 Nov 19 15:05:24.723317 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 121/260] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:24 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:25.142199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:25.142902 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:25.150258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.150708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.151673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.152117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.413323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:25.416116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:25.434988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.438422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.440059 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.444903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.478887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:25.489558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-12a51441-bdbf-4aa3-afb1-87b47004f525 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.351871 Nov 19 15:05:25.499697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 140/261] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:25 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:25.558770 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1d1ef377-7e70-4f89-8714-b7dcba07a240 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 24027 microversion: 2.20 time: 0.159168 Nov 19 15:05:25.561210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 122/262] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:25 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 24027 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:25.740920 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:25.741653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:25.763983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.764432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.767688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:25.769384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:25.802492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1941600093", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "b4ed2e73-3775-4a43-ae59-50f9a111138a"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:25.885887 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] validate_networks() for [('b4ed2e73-3775-4a43-ae59-50f9a111138a', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:05:26.016305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:26.028987 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7dd43c5c-777e-408b-9b45-350d9ee0a756 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.290735 Nov 19 15:05:26.031395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 141/263] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:25 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:26.507994 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:26.509924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:26.527747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.528848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.529866 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.530505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.797858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:05:26.801906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:05:26.803062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:05:26.803488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:05:26.803902 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:05:26.818720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.819173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.822255 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.822700 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.856821 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Getting quotas for project faec73be0ed44740b1d7128823a86838. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:26.866689 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Getting quotas for user cd9ca6d0907d46d9a96726414a4ae6da and project faec73be0ed44740b1d7128823a86838. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:26.885215 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:26.892917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:05:26.897556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3814f320-8599-4d68-93e0-e0279a35e70d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.392251 Nov 19 15:05:26.900347 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:05:26.910484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 142/264] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:26 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:26.921127 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:26.922851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:26.938872 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.939753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.942643 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:26.944030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:26.992158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e974843-8a35-4493-a967-47feebef5a80 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198336 Nov 19 15:05:26.993637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 123/265] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:05:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:05:27.006606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-2e5bd284-ad90-41cf-9f91-2cc3515cff86 req-ab79262f-60d8-43dd-9d8c-ddcacba73e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf74e04-9035-489f-b215-c529bd5be90d", "tag": "61ee76dd-0723-435f-bbf8-8a7d6039b176"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:27.010781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:27.010781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:05:27.021207 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-2e5bd284-ad90-41cf-9f91-2cc3515cff86 req-ab79262f-60d8-43dd-9d8c-ddcacba73e48 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:27.021857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-2e5bd284-ad90-41cf-9f91-2cc3515cff86 req-ab79262f-60d8-43dd-9d8c-ddcacba73e48 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:27.065818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a352adb2-690d-4376-a41d-d10bf770fda1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 25475 microversion: 2.20 time: 0.153760 Nov 19 15:05:27.067218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 143/266] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:26 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 25475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:27.088409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c3015113-c059-44f2-a59f-d3f3951f63ff tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:27.099095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-2e5bd284-ad90-41cf-9f91-2cc3515cff86 req-ab79262f-60d8-43dd-9d8c-ddcacba73e48 service nova] Creating event network-changed:61ee76dd-0723-435f-bbf8-8a7d6039b176 for instance 3cf74e04-9035-489f-b215-c529bd5be90d on hv-cinder-81757 Nov 19 15:05:27.099759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c3015113-c059-44f2-a59f-d3f3951f63ff tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:27.115476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-2e5bd284-ad90-41cf-9f91-2cc3515cff86 req-ab79262f-60d8-43dd-9d8c-ddcacba73e48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120084 Nov 19 15:05:27.117088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 124/267] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:27.146905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:27.148482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:27.167377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:27.169121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:27.173324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:27.173990 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:27.336547 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c3015113-c059-44f2-a59f-d3f3951f63ff tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:27.349479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c3015113-c059-44f2-a59f-d3f3951f63ff tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1219 microversion: 2.1 time: 0.278443 Nov 19 15:05:27.351676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 144/268] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:27 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:27.617291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:27.626556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bd37937d-2bc1-4dfc-a49e-5d6317c8d2b6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1521 microversion: 2.1 time: 0.505464 Nov 19 15:05:27.627147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 125/269] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:27 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:27.914798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:27.915418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:27.922835 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:27.923580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:27.924642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:27.925529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.079604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:28.080981 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:28.106264 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.106999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.108101 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.108862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.235541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3a9455b-b46d-485d-bf8a-cfbfae5a8502 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 26066 microversion: 2.20 time: 0.159224 Nov 19 15:05:28.236512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 126/270] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:28 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 26066 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:28.307168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:28.316763 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f9ef7dc2-489f-4f1a-b80b-8c4222749afc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.405454 Nov 19 15:05:28.327595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 145/271] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:27 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:28.371627 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:28.372748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:28.384865 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.385557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.387306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.388330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.465522 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:28.477589 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b31e729c-e6dc-46cf-b8e2-c8ab52049eb1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1271 microversion: 2.1 time: 0.110496 Nov 19 15:05:28.490750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 127/272] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:28 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:28.646790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:28.647980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:28.661294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.661845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:28.663389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:28.664126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.256113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:29.258497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:29.267638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.268453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.269574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.270015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.403020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:29.420058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-42317668-1449-4a51-a785-fb6b60b76934 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1501 microversion: 2.1 time: 0.775600 Nov 19 15:05:29.423532 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 146/273] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:28 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1501 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:29.428120 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:29.428737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:29.450134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.450596 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.453970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.454433 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.674727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:29.682937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c7b1493b-d58d-4af4-b83c-ee208292f876 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.258306 Nov 19 15:05:29.695538 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 147/274] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:29 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:29.709775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:29.711072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:29.717301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.717885 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:29.720271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:29.720840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:30.030134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:30.040259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fb05df5e-8693-4254-98bb-f5c7c646b73e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1516 microversion: 2.1 time: 0.335148 Nov 19 15:05:30.041455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 148/275] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:29 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:30.060609 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:30.061458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:30.067954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:30.068413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:30.069245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:30.069672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:30.378031 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:30.395863 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5ab7aa95-5e0d-45c6-b938-09b6440abff5 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.339717 Nov 19 15:05:30.396431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 149/276] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:30 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:30.702632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:30.704195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:30.716486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:30.717159 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:30.718147 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:30.721513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:30.949633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:30.959556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3781138d-4013-4436-b567-ac7a7a96db29 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.260816 Nov 19 15:05:30.970818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 150/277] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:30 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:31.415867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:31.417073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:31.423621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:31.424351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:31.425252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:31.425761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:31.559046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:31.566399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6ef79026-3533-4f25-b194-f94f44c6cce3 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.155954 Nov 19 15:05:31.566959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 151/278] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:31 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:31.678121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: .version_select at 0x7f37cc1a0940>, body: {"keypair": {"name": "tempest-keypair-1024069480"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:31.697918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:31.701545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:32.036603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:32.039762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9c36b23-2259-4907-9eb6-db225089cb63 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 27574 microversion: 2.20 time: 2.794694 Nov 19 15:05:32.042435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 128/279] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:29 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 27574 bytes in 2799 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:32.045787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:32.049936 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:32.055364 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:32.071818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8796fcf8-d4df-4960-b192-19fd4ae8de4f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.503010 Nov 19 15:05:32.077369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 152/280] 10.222.0.20 () {60 vars in 1157 bytes} [Fri Nov 19 15:05:31 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:32.078627 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.079099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.079924 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.080375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.576654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:32.578492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:32.585903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.586346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.587141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.587577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.614501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'flavor' on Instance uuid d257632a-adba-4ac6-8dd4-1be8485c24a7 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:05:32.623826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:32.638932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9857c050-17d3-4d63-84af-c447f13973f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.594773 Nov 19 15:05:32.640045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 129/281] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:32 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:32.649075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:32.650223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:32.663788 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.664612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.667159 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.669158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.730210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6c1912b1-8466-43f7-b47d-d5af5a31783a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action" status: 200 len: 32 microversion: 2.1 time: 0.156473 Nov 19 15:05:32.730999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 153/282] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:32 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:05:32.742371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:32.743371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:32.754615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.757042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.758258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:32.758774 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:32.933500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:32.950943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7816c5f8-fe85-457e-abc8-35166bcdf841 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.212551 Nov 19 15:05:32.952148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 154/283] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:32 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:33.052778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:33.054502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:33.069927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.070379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.071186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.071623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.180090 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:33.187816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-55119e4f-b091-41e0-93fb-5e1f4ee5d359 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28199 microversion: 2.20 time: 0.138823 Nov 19 15:05:33.188755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 155/284] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:33 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28199 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:33.198547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06c322e1-6dd9-442e-9752-4dc9bcfdbd4a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.555563 Nov 19 15:05:33.199363 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 130/285] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:32 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:33.562281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-5c43d613-5dcd-45ce-93f2-b44c325b5366 req-fb48ea34-8211-421e-bfff-d33f574a163d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2844a016-6b31-4f81-9afe-1b39957cbfe0", "tag": "0ac64702-51d3-49d3-8e87-d79ee4eb3855"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:33.563838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:33.563838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:33.588683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-5c43d613-5dcd-45ce-93f2-b44c325b5366 req-fb48ea34-8211-421e-bfff-d33f574a163d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.589777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-5c43d613-5dcd-45ce-93f2-b44c325b5366 req-fb48ea34-8211-421e-bfff-d33f574a163d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.617667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-5c43d613-5dcd-45ce-93f2-b44c325b5366 req-fb48ea34-8211-421e-bfff-d33f574a163d service nova] Creating event network-changed:0ac64702-51d3-49d3-8e87-d79ee4eb3855 for instance 2844a016-6b31-4f81-9afe-1b39957cbfe0 on hv-cinder-81757 Nov 19 15:05:33.630487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-5c43d613-5dcd-45ce-93f2-b44c325b5366 req-fb48ea34-8211-421e-bfff-d33f574a163d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074425 Nov 19 15:05:33.631313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 156/286] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:33.659451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:33.660066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:33.684215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.685036 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.689571 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.690178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.970265 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:33.971282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:33.986077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.987229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:33.990551 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:33.991247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:34.135824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:34.147178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-10ea8d85-48fd-45df-bc6d-1cb75171b8f8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.494507 Nov 19 15:05:34.160086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 131/287] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:33 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:34.200467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:34.202379 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:34.213477 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:34.214223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:34.215335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:34.225564 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:34.346488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac67a68a-c786-4ac8-adcc-3a2335b2e8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28199 microversion: 2.20 time: 0.150196 Nov 19 15:05:34.347144 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 132/288] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:34 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28199 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:34.356277 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:34.357013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:34.364318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:34.364948 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:34.365810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:34.366255 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:34.459958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:34.471883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-520d296a-0c5c-4db6-9cd8-9047c5ef8b7c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.506205 Nov 19 15:05:34.473376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 157/289] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:33 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:34.729929 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:34.738897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ab6804b4-63a8-4b28-8da1-0e123278cfe1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.390260 Nov 19 15:05:34.751728 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 133/290] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:34 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:35.169782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:35.170246 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:35.188328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.188941 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.189769 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.192730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.195528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1444464899", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed0406b4-0bfe-439f-b48b-c510341d69dd"}], "security_groups": [{"name": "tempest-securitygroup--44665572"}], "key_name": "tempest-keypair-1024069480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:35.390645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:35.403757 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2db914a3-de09-4614-973b-3939362d9d04 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.238750 Nov 19 15:05:35.414200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 158/291] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:35 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:35.414313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] validate_networks() for [('ed0406b4-0bfe-439f-b48b-c510341d69dd', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:05:35.419361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:35.420366 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:35.430410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.431025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.432543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.433239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.526553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d0b797aa-e5a2-4cdb-b5dc-b6585e1e8fce tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28490 microversion: 2.20 time: 0.117766 Nov 19 15:05:35.528692 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 159/292] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:35 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28490 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:35.538531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:35.539396 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:35.550609 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.551453 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.553448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.553912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.903052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:05:35.903476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:05:35.904337 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:05:35.904758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:05:35.905203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:05:35.916484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.917475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.920222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.921838 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.944868 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:35.950253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:35.958568 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:35.965288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:05:35.967691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8d723210-edba-4087-9950-661605c2d7c8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.435962 Nov 19 15:05:35.968377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 160/293] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:35 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:35.968855 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:05:35.982616 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:35.983220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:35.989973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.990419 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:35.991207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:35.991634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.028889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17c5b7b7-9464-4928-b2b0-7154ca34ff2f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.840356 Nov 19 15:05:36.030749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 134/294] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:05:35 2021] POST /compute/v2.1/servers => generated 400 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:05:36.042406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c813e530-0b90-4419-9ff8-1a60edd5fce7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:36.042938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c813e530-0b90-4419-9ff8-1a60edd5fce7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:36.119736 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c813e530-0b90-4419-9ff8-1a60edd5fce7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:36.128559 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c813e530-0b90-4419-9ff8-1a60edd5fce7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1238 microversion: 2.1 time: 0.090100 Nov 19 15:05:36.140939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 135/295] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:36 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:36.219821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:36.233156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4961f005-4320-4f8f-a9be-6f19834e69b1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.254005 Nov 19 15:05:36.246941 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 161/296] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:35 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:36.429321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:36.429851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:36.442449 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.442991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.447305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.447830 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.542232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:36.545245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:36.557335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.558235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.560634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.561967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.654532 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:36.664318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-088594a5-472b-44ed-b977-7030e38d2a21 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.246344 Nov 19 15:05:36.666512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 136/297] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:36 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:36.674103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-66871518-f3c4-4866-ba5e-3ce9885dcb1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.137088 Nov 19 15:05:36.675312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 162/298] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:36 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:36.986368 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:36.987272 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:36.994137 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.994883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:36.995967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:36.996415 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.149752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:37.150766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:37.159585 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.160534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.161823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.163210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.164751 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:37.177762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6876bb4b-63a5-4deb-94f4-fb3a24384a97 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.196283 Nov 19 15:05:37.178973 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 137/299] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:36 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:37.251375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:37.252206 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:37.254739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:37.260069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.261031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.262084 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.263136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.267996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a8d32ca2-dda1-4fb4-9556-e58ad401530e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1290 microversion: 2.1 time: 0.122354 Nov 19 15:05:37.269874 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 163/300] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:37 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:37.382419 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-5cce9721-e90f-4c72-96cb-7f6be79ed4b3 req-5f1f6715-aef6-4b7f-9447-0a85c333013f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf74e04-9035-489f-b215-c529bd5be90d", "name": "network-vif-plugged", "status": "completed", "tag": "61ee76dd-0723-435f-bbf8-8a7d6039b176"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:37.383947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:37.383947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:37.400733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-5cce9721-e90f-4c72-96cb-7f6be79ed4b3 req-5f1f6715-aef6-4b7f-9447-0a85c333013f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.401279 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-5cce9721-e90f-4c72-96cb-7f6be79ed4b3 req-5f1f6715-aef6-4b7f-9447-0a85c333013f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.423692 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-5cce9721-e90f-4c72-96cb-7f6be79ed4b3 req-5f1f6715-aef6-4b7f-9447-0a85c333013f service nova] Creating event network-vif-plugged:61ee76dd-0723-435f-bbf8-8a7d6039b176 for instance 3cf74e04-9035-489f-b215-c529bd5be90d on hv-cinder-81757 Nov 19 15:05:37.433535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-5cce9721-e90f-4c72-96cb-7f6be79ed4b3 req-5f1f6715-aef6-4b7f-9447-0a85c333013f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054932 Nov 19 15:05:37.436446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 164/301] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:37.630745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:37.667265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-808c3b8e-afed-4dd9-afac-e10861949687 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.419601 Nov 19 15:05:37.667969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 138/302] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:37 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:37.682980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:37.684323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:37.688093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:37.689830 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:37.691708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.692239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.693137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.693653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.706996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.707383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.708173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:37.708607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:37.789106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e3d59ecd-697f-49eb-88bc-704fbbbdf670 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.103570 Nov 19 15:05:37.789106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 139/303] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:37 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:37.902747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:37.915293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-16c3e67c-25de-4678-9dd9-b368053c900d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.236359 Nov 19 15:05:37.916212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 165/304] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:37 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:38.195179 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:38.196887 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:38.205213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.205941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.206942 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.207376 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.286280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:38.287171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:38.300613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.301309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.302119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.303002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.369679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:38.378603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-89318133-3939-42b0-b932-cc663ea0b62d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1296 microversion: 2.1 time: 0.096041 Nov 19 15:05:38.379171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 166/305] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:38 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:38.453102 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:38.461887 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12ff9ac2-7b13-46bd-b0a5-99645e8f8d9c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.270546 Nov 19 15:05:38.462476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 140/306] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:38 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:38.686229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:38.687300 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:38.697338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.697883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.698825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.699351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.799583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:38.801173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:38.807864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.808408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.809301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.809798 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.873714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:38.881592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-05898c7d-92d2-4ad3-8932-20438423eaef tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.199047 Nov 19 15:05:38.882156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 167/307] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:38 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:38.892084 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e24bd6ed-b864-4a64-9af2-0df9ea93020a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.096854 Nov 19 15:05:38.896748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 141/308] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:38 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:38.931571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:38.931778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:38.939092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.940008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:38.940828 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:38.941393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.104970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:39.114189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fdff9208-f010-4c92-a316-b7ba1c757819 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1317 microversion: 2.1 time: 0.185899 Nov 19 15:05:39.116305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 168/309] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:38 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:39.401959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:39.410617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-7ec8fdd1-65b6-4dd3-942e-64c24682ee03 req-490229d6-cc5d-4529-a86f-0be9ef45ed41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d60727-6b69-40d5-81e4-79f73038581b", "tag": "211e7156-2ffd-4fd3-879a-c68f83d6e874"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:39.412093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:39.412575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:39.412575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:39.422218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-7ec8fdd1-65b6-4dd3-942e-64c24682ee03 req-490229d6-cc5d-4529-a86f-0be9ef45ed41 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.422912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-7ec8fdd1-65b6-4dd3-942e-64c24682ee03 req-490229d6-cc5d-4529-a86f-0be9ef45ed41 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.432105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.432566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.433469 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.433959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.443506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-7ec8fdd1-65b6-4dd3-942e-64c24682ee03 req-490229d6-cc5d-4529-a86f-0be9ef45ed41 service nova] Creating event network-changed:211e7156-2ffd-4fd3-879a-c68f83d6e874 for instance 28d60727-6b69-40d5-81e4-79f73038581b on hv-cinder-81757 Nov 19 15:05:39.449391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-7ec8fdd1-65b6-4dd3-942e-64c24682ee03 req-490229d6-cc5d-4529-a86f-0be9ef45ed41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042910 Nov 19 15:05:39.450553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 169/310] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:05:39.460985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-7b235dd0-bf7a-4e25-8500-07fad80be249 req-9ac8d0ae-9f5e-4577-a215-ea41f73e4bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2844a016-6b31-4f81-9afe-1b39957cbfe0", "name": "network-vif-plugged", "status": "completed", "tag": "0ac64702-51d3-49d3-8e87-d79ee4eb3855"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:39.462409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:39.462409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:39.472095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-7b235dd0-bf7a-4e25-8500-07fad80be249 req-9ac8d0ae-9f5e-4577-a215-ea41f73e4bed service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.472449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-7b235dd0-bf7a-4e25-8500-07fad80be249 req-9ac8d0ae-9f5e-4577-a215-ea41f73e4bed service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.492331 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-7b235dd0-bf7a-4e25-8500-07fad80be249 req-9ac8d0ae-9f5e-4577-a215-ea41f73e4bed service nova] Creating event network-vif-plugged:0ac64702-51d3-49d3-8e87-d79ee4eb3855 for instance 2844a016-6b31-4f81-9afe-1b39957cbfe0 on hv-cinder-81757 Nov 19 15:05:39.497985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-7b235dd0-bf7a-4e25-8500-07fad80be249 req-9ac8d0ae-9f5e-4577-a215-ea41f73e4bed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041782 Nov 19 15:05:39.499739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 170/311] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:05:39.506131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:39.509297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:39.516840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.517696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.518556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.519083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.719661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:39.735806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c1813337-2d03-4c70-a7aa-c7fc550eb524 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.234690 Nov 19 15:05:39.736831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 171/312] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:39 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:39.741273 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:39.750258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c4204f1-04c1-44d9-b7c7-bbbec12f8bbb tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.358272 Nov 19 15:05:39.751188 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 142/313] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:39 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:39.902524 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:39.903551 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:39.904081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:39.907343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:39.912301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.912859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.913656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.914004 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.914105 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.914555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:39.915402 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:39.915906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.050396 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:40.057729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-179c09db-fd4d-4f58-b7b4-a32d72297899 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.163134 Nov 19 15:05:40.058287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 172/314] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:39 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:40.131995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:40.132598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:40.138557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.138998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.140489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.140952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.237802 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-806dc34d-098d-40cb-b92d-00819d7a3e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.337759 Nov 19 15:05:40.238448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 143/315] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:39 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:40.271056 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:40.278335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-316fa04d-9ac4-4e2a-9104-b2a03159f62d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1507 microversion: 2.1 time: 0.149963 Nov 19 15:05:40.278895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 173/316] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:40 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:40.295196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68107d4c-e27a-44ec-bdec-8e6266441350"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:40.296903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:40.303613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.304063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.304871 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.305313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.390464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Invalid volume: volume 68107d4c-e27a-44ec-bdec-8e6266441350 is already attached to instances: 5d137ea7-786a-4fb3-bb1f-95d526175a90 Nov 19 15:05:40.391087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 400 to user: Invalid volume: volume 68107d4c-e27a-44ec-bdec-8e6266441350 is already attached to instances: 5d137ea7-786a-4fb3-bb1f-95d526175a90 {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:05:40.391934 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a25234a-bd0d-4175-b090-a353f153c63c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100929 Nov 19 15:05:40.392502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 144/317] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:05:40 2021] POST /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:05:40.451045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:40.451537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:40.457966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.458410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.459191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.459622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.584547 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lazy-loading 'services' on Instance uuid 5d137ea7-786a-4fb3-bb1f-95d526175a90 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:05:40.761778 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:40.762969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:40.773812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.774517 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.775567 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.776222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.857042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7b4f09c2-4133-4b44-ad20-4b4d42585cf7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments/68107d4c-e27a-44ec-bdec-8e6266441350" status: 202 len: 0 microversion: 2.1 time: 0.409509 Nov 19 15:05:40.857684 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 174/318] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:05:40 2021] DELETE /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments/68107d4c-e27a-44ec-bdec-8e6266441350 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:40.866025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:40.867229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:40.877947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.878431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:40.879534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:40.880013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.008284 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:41.019135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba930987-3b55-4e46-88c4-33babf48b1ca tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.268647 Nov 19 15:05:41.019707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 145/319] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:40 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:41.029099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:41.030397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:41.033674 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:41.037232 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.037756 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.038608 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.039047 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.041721 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ddb3cd3b-beee-42f7-bd5c-81bf2dd9ff14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.179542 Nov 19 15:05:41.042143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 175/320] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:40 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:41.070197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1318926-7bef-4b4b-96e8-aa50e8bbc06e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Nov 19 15:05:41.071046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 146/321] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:05:41 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:41.075704 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:41.076324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:41.082553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.083093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.083874 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.084320 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.217251 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:41.224536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fa210f90-b762-4f23-beed-8dd5a816f33a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1319 microversion: 2.1 time: 0.153343 Nov 19 15:05:41.225119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 176/322] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:41 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:41.248740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:41.249729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:41.255985 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.256435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.257234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:41.257669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:41.356682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76ef5205-4c11-4832-a3be-c6896f2d680a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.111382 Nov 19 15:05:41.357268 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 147/323] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:41 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:42.035410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:42.036000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:42.042248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.042747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.043519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.044182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.059725 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:42.061281 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:42.069661 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.070118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.070916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.071362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.180989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:42.193959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ec30959e-6211-4f84-8c76-555f88339d05 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.161944 Nov 19 15:05:42.195061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 177/324] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:42 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:42.199702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:42.200768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:42.207024 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.207566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.208438 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.209002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.229574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:42.239024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e84e256-b886-4282-bbcd-9cc2ab21a6ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.183546 Nov 19 15:05:42.239380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-37d330b5-2219-4ff5-9bce-dd16163682ee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043197 Nov 19 15:05:42.239593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 148/325] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:42 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:42.244144 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 178/326] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:05:42 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:42.244289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:42.245488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:42.252718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.253201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.253993 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.254434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.367758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:42.368679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:42.375063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.375623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.376665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:42.376873 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:42.397662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:42.404467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-983e80a9-073e-4d49-9f23-93b810634a4f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1507 microversion: 2.1 time: 0.163913 Nov 19 15:05:42.405568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 149/327] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:42 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:42.410653 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2093572912", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "cd986946-8454-44e7-80e5-6d3c5bfe30eb"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:42.449280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-08269e54-fb9c-4b33-bebc-54c236d33a57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 28658 microversion: 2.20 time: 0.084920 Nov 19 15:05:42.449834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 179/328] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:42 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 28658 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:05:43.212685 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:43.213409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:43.220607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.221079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.221860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.222292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.354646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:43.362818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-611d21e7-24c5-4a80-a61f-451b3a94830f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.154922 Nov 19 15:05:43.363379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 180/329] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:43 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:43.367505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:43.368103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:43.373476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.374536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.375553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.375989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.510578 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:43.517812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4dcfda65-8be3-4559-be11-13c914b69968 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.153506 Nov 19 15:05:43.518368 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 181/330] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:43 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:43.522633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:43.523565 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:43.529025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.529478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.530310 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:43.530743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:43.637912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c021a752-3973-462b-b4a7-f39f87bd42b5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 29468 microversion: 2.20 time: 0.118297 Nov 19 15:05:43.639142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 182/331] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:43 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 29468 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:44.380607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:44.381376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:44.388123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.388580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.389409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.390522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.522731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:44.531285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c75e54ff-3c24-4af6-918b-6f52d7e6283c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.154649 Nov 19 15:05:44.531844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 183/332] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:44 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:44.535970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:44.536573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:44.541955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.542403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.543178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.543613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.678017 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:44.685275 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c387877b-55fa-4bb7-8a25-e20728977b0b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.152444 Nov 19 15:05:44.685831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 184/333] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:44 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:44.690102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:44.691004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:44.696388 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.696859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.697636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:44.698072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:44.798749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7e391e07-76e6-4f1b-a9f7-ba1359cc4f1d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 30804 microversion: 2.20 time: 0.111683 Nov 19 15:05:44.799520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 185/334] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:44 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 30804 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:45.291688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-52b36b75-e034-45ad-9480-cde9b1a81803 req-baebfaa0-705c-48e5-ae5d-d9fd71432d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60727-6b69-40d5-81e4-79f73038581b", "name": "network-vif-plugged", "status": "completed", "tag": "211e7156-2ffd-4fd3-879a-c68f83d6e874"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:45.293319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:45.293319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:45.302783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-52b36b75-e034-45ad-9480-cde9b1a81803 req-baebfaa0-705c-48e5-ae5d-d9fd71432d94 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.303222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-52b36b75-e034-45ad-9480-cde9b1a81803 req-baebfaa0-705c-48e5-ae5d-d9fd71432d94 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.317587 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-52b36b75-e034-45ad-9480-cde9b1a81803 req-baebfaa0-705c-48e5-ae5d-d9fd71432d94 service nova] Creating event network-vif-plugged:211e7156-2ffd-4fd3-879a-c68f83d6e874 for instance 28d60727-6b69-40d5-81e4-79f73038581b on hv-cinder-81757 Nov 19 15:05:45.322427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-52b36b75-e034-45ad-9480-cde9b1a81803 req-baebfaa0-705c-48e5-ae5d-d9fd71432d94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Nov 19 15:05:45.323337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 186/335] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:05:45.548515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:45.549277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:45.555583 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.556052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.556829 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.557270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.695694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:45.703590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-803cd389-d106-42c1-81e6-a5018e388268 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.159338 Nov 19 15:05:45.703722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 187/336] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:45 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:45.707884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:45.708480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:45.713923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.714645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.715415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.715851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.846162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:45.853198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1421867d-b679-4e81-9995-6a690d815102 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.148617 Nov 19 15:05:45.853747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 188/337] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:45 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:45.858033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:45.859505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:45.864911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.865355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.866119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:45.866550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:45.971894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f7b376f4-47d2-4cb7-a0dd-59a6db3c82fd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 32092 microversion: 2.20 time: 0.116908 Nov 19 15:05:45.972562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 189/338] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:45 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 32092 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:46.720450 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:46.721137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:46.727912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:46.728363 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:46.729176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:46.729614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:46.862871 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:46.871255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a0777bab-d80d-4c72-ae5c-75fecc188fd6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.155102 Nov 19 15:05:46.871831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 190/339] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:46 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:46.876998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:46.877592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:46.883295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:46.883740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:46.884508 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:46.884969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:47.015768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:47.022923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d32e8909-1457-438f-91a9-1f66373826f7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1362 microversion: 2.1 time: 0.149878 Nov 19 15:05:47.023470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 191/340] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:46 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:47.027732 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:47.028628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:47.038215 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:47.038789 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:47.039846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:47.040377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:47.175929 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-990337ac-998b-4324-b89a-769f18f89d1e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 33201 microversion: 2.20 time: 0.151224 Nov 19 15:05:47.176598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 192/341] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:47 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 33201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:47.888362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:47.889080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:47.896035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:47.896477 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:47.897289 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:47.897721 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.027712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:48.035426 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a128ed8c-524d-46b7-bb5e-30cbd407b59c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.151116 Nov 19 15:05:48.035983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 193/342] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:47 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:48.041148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:48.041746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:48.047775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.048223 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.049028 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.049464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.189395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:48.196608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3c214931-f73b-410f-9049-bf658d2cdba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1548 microversion: 2.1 time: 0.158660 Nov 19 15:05:48.197253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 194/343] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:48 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:48.201456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:48.202353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:48.207732 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.208178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.208979 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.209412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.300545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ef67b7f4-a790-4fe7-bf1f-fdb50e24f6a7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 33748 microversion: 2.20 time: 0.101962 Nov 19 15:05:48.304476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 195/344] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:48 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 33748 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:48.306194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:48.306773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:48.313824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.314274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.315052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:48.315481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:48.393238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-aa9b6a7e-ce92-4573-be4a-2f466558477b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090651 Nov 19 15:05:48.393838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 196/345] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Nov 19 15:05:48 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:49.053130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:49.053753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:49.059778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.060377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.061798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.062235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.321837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:49.329875 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-702770b9-552f-4070-8956-4384b29b3a28 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.280768 Nov 19 15:05:49.330656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 197/346] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:49 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:49.344783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:49.345727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:49.351559 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.352011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.352802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.353260 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.439537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b1c7ac56-6cdd-4198-868d-5293b82bc783 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 34394 microversion: 2.20 time: 0.098274 Nov 19 15:05:49.441099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 198/347] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:49 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 34394 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:49.445164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:49.446151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:49.453645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.454099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.454889 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.455328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.543509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2b3a9f13-38cf-4558-9966-95bfd5edc658 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.101871 Nov 19 15:05:49.546820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 199/348] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:49 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:49.548990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-f0eccc77-cb01-41bf-864e-f59c4d4573f0 req-b562442f-6381-477b-8ccf-3ee29665a987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d60727-6b69-40d5-81e4-79f73038581b", "tag": "211e7156-2ffd-4fd3-879a-c68f83d6e874"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:49.550444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:05:49.550444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:05:49.557931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-f0eccc77-cb01-41bf-864e-f59c4d4573f0 req-b562442f-6381-477b-8ccf-3ee29665a987 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:49.558375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-f0eccc77-cb01-41bf-864e-f59c4d4573f0 req-b562442f-6381-477b-8ccf-3ee29665a987 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:49.569117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-f0eccc77-cb01-41bf-864e-f59c4d4573f0 req-b562442f-6381-477b-8ccf-3ee29665a987 service nova] Creating event network-changed:211e7156-2ffd-4fd3-879a-c68f83d6e874 for instance 28d60727-6b69-40d5-81e4-79f73038581b on hv-cinder-81757 Nov 19 15:05:49.573792 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-f0eccc77-cb01-41bf-864e-f59c4d4573f0 req-b562442f-6381-477b-8ccf-3ee29665a987 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028366 Nov 19 15:05:49.574391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 200/349] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:05:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:05:50.348946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:50.350335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:50.356762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.357247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.358191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.358641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.505243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:50.512628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-aacd4e92-549e-414e-a4fa-9f3ce3b37186 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.168184 Nov 19 15:05:50.513231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 201/350] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:50 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:50.518175 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:50.519091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:50.525073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.525574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.526409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.526948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.631130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-68434803-bacd-4400-a307-ce62f088e0d2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 34875 microversion: 2.20 time: 0.116675 Nov 19 15:05:50.631770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 202/351] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:50 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 34875 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:50.636643 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:50.637659 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:50.644488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.644975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.645750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:50.646192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:50.727146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-51144ac4-4818-4c7e-b848-c65adb48ea4c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.093884 Nov 19 15:05:50.727858 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 203/352] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:50 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:51.530300 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:51.530995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:51.537794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.538246 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.539014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.539447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.671894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:51.679553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3fec92ac-aa1c-4571-9e18-9e36b1cbbe3d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.153286 Nov 19 15:05:51.680115 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 204/353] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:51 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:51.684357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:51.685297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:51.690836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.691280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.692050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.692489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.800964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-70c91d3f-25ab-4fec-986c-73737df67eb9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 35707 microversion: 2.20 time: 0.119583 Nov 19 15:05:51.801637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 205/354] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:51 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 35707 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:51.806730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:51.808031 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:51.815688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.816136 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.816955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:51.817397 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:51.883362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-719bc0f2-98a6-4c47-9a94-484a62709766 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.080027 Nov 19 15:05:51.883916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 206/355] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:51 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:52.697356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:52.698031 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:52.705590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.707292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:52.708133 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.708583 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:52.855968 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:52.864537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f80fd218-0bd9-478e-bb6d-76cf1e5067da tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.171103 Nov 19 15:05:52.865154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 207/356] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:52 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:52.869648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:52.870557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:52.877002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.877449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:52.878220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.878655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:52.967074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-57c87be5-ef75-4874-9164-900387c31dc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 36645 microversion: 2.20 time: 0.100549 Nov 19 15:05:52.972397 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 208/357] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:52 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 36645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:52.972622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:52.973525 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:52.980497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.980976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:52.981762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:52.982198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:53.057792 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-df30e959-741a-4f4b-b9e3-9d0a4c714765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.088747 Nov 19 15:05:53.058456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 209/358] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:52 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:53.883025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:53.883710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:53.891010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:53.891459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:53.892306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:53.892679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:54.023790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:54.032075 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5f9bd813-3863-4e14-9cea-11e4d1f2b13c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.153060 Nov 19 15:05:54.032637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 210/359] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:53 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:54.036912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:54.037811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:54.043242 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:54.043695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:54.044468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:54.045008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:54.156692 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f1c6d729-90d5-4e2f-bba0-a666ddf93ac4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 37579 microversion: 2.20 time: 0.122766 Nov 19 15:05:54.157360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 211/360] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:54 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 37579 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:54.162355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:54.163341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:54.170072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:54.171317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:54.172281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:54.172722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:54.254850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-51671d0a-deda-4e27-b738-befafcbcf757 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.095821 Nov 19 15:05:54.255753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 212/361] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:54 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:55.049808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:55.050418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:55.057454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.057907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.058972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.059415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.200174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:55.207691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-12c0910e-5e6f-46d5-b089-8b51271f851e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.162109 Nov 19 15:05:55.208244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 213/362] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:55 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:55.212460 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:55.213382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:55.219363 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.219829 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.220639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.221209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.312997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-64f489f9-ab4b-4ea1-be2f-97db1e69312c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 38193 microversion: 2.20 time: 0.103455 Nov 19 15:05:55.313532 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 214/363] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:55 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 38193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:55.318266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:55.319239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:55.325847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.326293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.327149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:55.327575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:55.414764 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c042f097-dee6-4036-ad7f-6df4c7c48f67 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.099370 Nov 19 15:05:55.415042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 215/364] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:55 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:56.226123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:56.226856 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:56.234334 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.234774 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.235558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.235995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.363934 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:56.371843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4196f88f-8933-4849-9b6c-7e1ee4c46ea7 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.150162 Nov 19 15:05:56.372412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 216/365] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:56 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:56.377232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:56.378136 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:56.383746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.384192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.385012 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.385449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.458114 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-265b8570-9e39-4eaf-8b12-59ae778be680 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 38193 microversion: 2.20 time: 0.084419 Nov 19 15:05:56.458742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 217/366] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:56 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 38193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:56.464488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:56.465505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:56.472673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.473151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.473926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:56.474357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:56.564253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-be94b7f6-2a9e-4b8c-86d7-85e4c55b050f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.104021 Nov 19 15:05:56.564803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 218/367] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:56 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:57.390731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:57.391434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:57.398566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.399065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.399866 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.400306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.534686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:57.542084 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8ed683f7-9447-46b6-bcbc-c39af63d8513 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.156271 Nov 19 15:05:57.544177 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 219/368] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:57 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:57.548455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:57.549434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:57.556041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.556517 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.557362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.557792 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.639679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3485a7de-a4e5-40ec-b35f-6000ba9445b4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 38193 microversion: 2.20 time: 0.095170 Nov 19 15:05:57.640350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 220/369] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:57 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 38193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:57.645595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:57.646509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:57.653280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.653723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.654499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:57.655063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:57.722545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3a937189-36d6-44b6-b64d-37be9e02b8f3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.080545 Nov 19 15:05:57.723178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 221/370] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:57 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:57.969345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] validate_networks() for [('cd986946-8454-44e7-80e5-6d3c5bfe30eb', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:05:58.354270 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:05:58.354696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:05:58.355175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:05:58.355584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:05:58.356028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:05:58.364758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.365314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.366127 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.366563 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.383119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:05:58.387042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for user ba4aff19ddd54325b884984bb6ddc144 and project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:05:58.398245 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:05:58.400516 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:05:58.444158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-add9c594-6780-44c6-b0b9-386f6a835e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.036887 Nov 19 15:05:58.444706 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 150/371] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:05:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 16039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:05:58.455264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7dbacb66-0fc1-4904-92c5-fb1eb2a784ca tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:58.455961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7dbacb66-0fc1-4904-92c5-fb1eb2a784ca tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:58.520765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7dbacb66-0fc1-4904-92c5-fb1eb2a784ca tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:58.527677 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7dbacb66-0fc1-4904-92c5-fb1eb2a784ca tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1218 microversion: 2.1 time: 0.076774 Nov 19 15:05:58.528617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 222/372] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:58 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:58.562087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:58.562617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:58.573241 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.573691 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.574664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.575287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.652353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:58.653383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:58.663004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.663722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.664577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.665264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.758165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:58.766855 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d3359e7-b247-4ca4-bae9-8c253fd625fa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.209632 Nov 19 15:05:58.767983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 151/373] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:58 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:05:58.770141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0fe65ffe-f6f1-4dba-beba-278bc31e57e4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 200 len: 38332 microversion: 2.20 time: 0.122252 Nov 19 15:05:58.770856 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 223/374] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:05:58 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 38332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:05:58.780488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:58.781230 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:58.781659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:58.781951 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:58.788466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.789004 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.789124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.789491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.789793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.790228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.790461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:58.790906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:58.819040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-749749ff-57ea-48a2-b786-2873d8740257 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/ips" status: 200 len: 151 microversion: 2.20 time: 0.041945 Nov 19 15:05:58.819950 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 224/375] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Nov 19 15:05:58 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:05:58.865823 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3d006ad7-707c-4979-8b43-d54bf0fcb9b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.091582 Nov 19 15:05:58.869815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 152/376] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:58 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:05:59.545380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:59.546138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:59.552435 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.552919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.553735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.554380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.646522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:59.656266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-534799c9-ea76-415d-b849-0ea2b5ca6a4c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1270 microversion: 2.1 time: 0.114509 Nov 19 15:05:59.657097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 225/377] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:59 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:05:59.784319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:05:59.785070 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:59.791895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.792350 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.793171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.793613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.878057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:05:59.878980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:05:59.885842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.886369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.887362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:05:59.887847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:05:59.962789 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0397602f-c2e8-4e01-95b4-8a6c1ff8f220 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.089756 Nov 19 15:05:59.963823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 226/378] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:05:59 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:05:59.985845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:05:59.993946 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a0e0bd73-a866-4d44-b2ee-007dd8be875c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.214132 Nov 19 15:05:59.994532 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 153/379] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:05:59 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:00.677132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:00.679103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:00.689007 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:00.689542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:00.700911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:00.702465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:00.862155 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:00.869712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5ba1b521-dd4c-47f6-9346-ea8b4ed9cf8c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.199694 Nov 19 15:06:00.870278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 227/380] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:00 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:00.974834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:00.975714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:00.982126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:00.982578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:00.983745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:00.984168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.011204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:01.011823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:01.019181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.019639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.020501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.021014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.094181 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-287ad254-16d5-4623-a372-d07413c2d367 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.122833 Nov 19 15:06:01.099088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 154/381] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:00 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:01.203520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:01.211238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-63181762-a0b7-48c3-a674-413a32ed5332 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.203697 Nov 19 15:06:01.211842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 228/382] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:01 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:01.266889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:01.268267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:01.275624 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.276076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.276914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.277359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.304029 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lazy-loading 'flavor' on Instance uuid 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:06:01.742866 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-d1fbd5a4-17b4-4c13-b812-db55bd04db79 req-de1a92cc-305e-4160-981a-56ff74ee3d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e373f462-cbce-4d02-8a0b-b96fb6b005f9", "tag": "5f995ca5-5a2a-41de-8527-16927df2788a"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:01.744394 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:06:01.744394 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:06:01.783678 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d1fbd5a4-17b4-4c13-b812-db55bd04db79 req-de1a92cc-305e-4160-981a-56ff74ee3d7b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.784260 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d1fbd5a4-17b4-4c13-b812-db55bd04db79 req-de1a92cc-305e-4160-981a-56ff74ee3d7b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.802992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-d1fbd5a4-17b4-4c13-b812-db55bd04db79 req-de1a92cc-305e-4160-981a-56ff74ee3d7b service nova] Creating event network-changed:5f995ca5-5a2a-41de-8527-16927df2788a for instance e373f462-cbce-4d02-8a0b-b96fb6b005f9 on hv-cinder-81757 Nov 19 15:06:01.812672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-d1fbd5a4-17b4-4c13-b812-db55bd04db79 req-de1a92cc-305e-4160-981a-56ff74ee3d7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077537 Nov 19 15:06:01.814530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 229/383] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:06:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:01.887709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:01.888682 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:01.896093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.896588 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:01.897633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:01.898076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.015637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4d4fc81f-e682-4443-ba99-36844d400bc6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 202 len: 0 microversion: 2.20 time: 0.756468 Nov 19 15:06:02.016274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 155/384] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:06:01 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:06:02.026388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:02.027824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.036009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.036603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.037554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.038211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.057499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.066377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dab2d09f-2f10-4b7e-85a4-a2fa583bef03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.182957 Nov 19 15:06:02.067071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 230/385] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:01 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:02.104276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:02.105221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.111195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.112280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.113106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.113546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.196564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4387e16b-251b-42fb-9210-0adac8dace27 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.095732 Nov 19 15:06:02.197233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 231/386] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:02 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:06:02.229267 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:02.229983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.237492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.237943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.238723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.239162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.268178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.287782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.294806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.296547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f213128-e062-4790-9e10-d6456d4beac2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.275528 Nov 19 15:06:02.297119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 156/387] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:02 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:02.380772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.388063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-20089779-1de1-4744-b545-ca09b3d24c37 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1502 microversion: 2.1 time: 0.162820 Nov 19 15:06:02.388634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 232/388] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:02 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:02.405235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2a9fe22-2797-481f-b693-6a2e7d3cd7a7"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:02.406659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.412425 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.412914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.413721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.414141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.440225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] HTTP exception thrown: Cannot 'attach_volume' instance d257632a-adba-4ac6-8dd4-1be8485c24a7 while it is in vm_state rescued Nov 19 15:06:02.440843 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Returning 409 to user: Cannot 'attach_volume' instance d257632a-adba-4ac6-8dd4-1be8485c24a7 while it is in vm_state rescued {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:06:02.441677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-442b6b32-966d-4691-9021-9717296c7b48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040911 Nov 19 15:06:02.442475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 157/389] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:06:02 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 19 15:06:02.450597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:02.451132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.457734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.458184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.458964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.459400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.538050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ed37e2f3-8852-447e-924a-8ca794de148f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action" status: 202 len: 0 microversion: 2.1 time: 0.090829 Nov 19 15:06:02.538675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 233/390] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:02 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:06:02.548382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:02.549234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:02.557810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.558495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.559459 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:02.559895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:02.902026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:02.910796 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac38d2ca-3873-4bc2-95d8-234cd00134bc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1510 microversion: 2.1 time: 0.367532 Nov 19 15:06:02.911355 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 158/391] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:02 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:03.084075 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:03.084912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:03.091651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.092305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.093132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.093574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.207580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:03.208502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:03.214939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.215389 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.216412 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.216889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.241862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:03.252784 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ea0f82ce-5fa3-4e4f-94ea-57a963885e8d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.172652 Nov 19 15:06:03.253393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 234/392] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:03 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:03.314175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3cd02c0a-5842-4946-bf7f-4c14c44bb84a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.110106 Nov 19 15:06:03.314792 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 159/393] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:03 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:03.315680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:03.316295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:03.322094 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.322544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.323335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.323781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.460608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:03.469318 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:03.470833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:03.471973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f945ad1e-89da-4c28-8c91-472c61d99b17 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.160516 Nov 19 15:06:03.472532 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 235/394] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:03 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:03.928677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:03.929501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:03.936571 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.937140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:03.937998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:03.938502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.072311 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:04.080738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-abcf26bf-527c-4a00-989c-672bccdea9e6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1510 microversion: 2.1 time: 0.156331 Nov 19 15:06:04.081344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 160/395] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:03 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:04.269880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:04.270391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:04.276602 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.277082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.277850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.278282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.325448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:04.327267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:04.334179 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.334626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.335404 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.335839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.408690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0959e484-7aa5-43b6-acef-2cf63caffe9d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.087054 Nov 19 15:06:04.409707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 161/396] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:04 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:06:04.411760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:04.419250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1972dd04-5d20-405e-b33b-98c218eac2e0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.153178 Nov 19 15:06:04.419812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 236/397] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:04 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:04.490839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:04.491591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:04.499904 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.500406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.501240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:04.501793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:04.646898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:04.654704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:04.656626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:04.657866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-110c04e8-a0e4-4a65-9b14-e2afad31bf90 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.171486 Nov 19 15:06:04.658421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 162/398] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:04 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:05.099861 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:05.100591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:05.108384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.108854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.109647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.110078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.243744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:05.251418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-befa4763-f896-4e5c-838c-b615c55e1212 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1510 microversion: 2.1 time: 0.155969 Nov 19 15:06:05.251970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 237/399] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:05 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:05.419478 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:05.421007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:05.427318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.427766 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.428542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.429031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.435231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:05.436079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:05.442569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.443021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.443806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.444245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.517301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e505dcd1-17fc-4941-b556-912fa70936ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.101132 Nov 19 15:06:05.520328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 163/400] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:05 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:05.573955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:05.581711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-48871bcb-32ca-40e7-836d-fd402fab2f5e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.150269 Nov 19 15:06:05.582270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 238/401] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:05 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:05.676223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:05.676938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:05.683748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.684197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.685010 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:05.685451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:05.817794 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:05.826957 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:05.828613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:05.829831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2b8551b-571e-4829-a382-a229da6f6f84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.157660 Nov 19 15:06:05.830379 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 164/402] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:05 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:06.268779 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:06.269405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:06.275230 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.275675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.276437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.276894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.409186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:06.416307 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4b099361-dff4-403f-96dc-de904306c15e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1510 microversion: 2.1 time: 0.151164 Nov 19 15:06:06.416900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 239/403] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:06 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:06.527441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:06.528352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:06.535771 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.536216 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.537134 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.537570 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.598845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:06.599449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:06.606298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.606747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.608255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.608636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.629747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b2b19600-c277-4e9a-ac19-9b5b7a2ee1c5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.105825 Nov 19 15:06:06.630378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 165/404] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:06 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:06.742750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:06.751315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c479c984-a76e-44de-910e-236fc546bb25 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.156008 Nov 19 15:06:06.752165 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 240/405] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:06 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:06.851088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:06.851774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:06.858947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.859336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.860107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:06.860536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:06.994424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:07.002939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:07.004545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:07.005832 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-596e6351-33d3-4097-b652-9884568e467d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.158762 Nov 19 15:06:07.006395 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 166/406] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:06 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:07.433304 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:07.433915 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:07.440080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.440533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.441403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.441902 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.576258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:07.584912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-95391df4-93ed-46fb-bd09-e190396a0a32 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1516 microversion: 2.1 time: 0.155005 Nov 19 15:06:07.585483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 241/407] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:07 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:07.640916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:07.642175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:07.651304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.651304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.651304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.651304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.729240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed98887b-4c10-4a0c-a27d-06af80a3126b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.093137 Nov 19 15:06:07.732340 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 167/408] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:07 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:07.768138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:07.768748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:07.774955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.775412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.776301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:07.776733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:07.916115 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:07.923903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-53fd267b-346d-4d09-a69a-672c452c3ea7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.160240 Nov 19 15:06:07.924468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 242/409] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:07 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:08.024396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:08.025052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:08.032401 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.032879 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.033664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.034104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.168744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:08.177100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:08.178603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:08.179752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-87bce5a7-b88c-4686-9037-7463b5da0bb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.159534 Nov 19 15:06:08.180342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 168/410] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:08 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:08.739813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:08.740811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:08.747039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.747491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.748461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.748965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.815333 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-426df707-6a07-4d89-bca0-01198e1ef938 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.078961 Nov 19 15:06:08.815934 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 243/411] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:08 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:08.912213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:08.912852 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:08.919230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.919685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.920528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.921009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.940645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:08.941376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:08.948175 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.948618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:08.949411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:08.949842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.050949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:09.058165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4faf9c1-6bb7-48c8-8da2-31981a66452d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1516 microversion: 2.1 time: 0.151637 Nov 19 15:06:09.058730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 169/412] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:08 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:09.075091 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea147ac8-d149-4aab-ab48-0b8d5c3aabf4"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:09.076144 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:09.082112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.082417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:09.082556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.083373 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.083815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.090606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6f044475-746c-48e0-a4d3-ad2819e14314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.153870 Nov 19 15:06:09.091162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 244/413] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:08 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:09.199527 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:09.200425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:09.209305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.209996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.210796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.211235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.382329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a16760ae-4e7c-437e-abcc-be065f0e001d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310482 Nov 19 15:06:09.388549 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 170/414] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:06:09 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:06:09.396305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-93cda589-f94f-4d0b-b90d-82420a69199f req-d880d66f-0101-4558-9867-84c47e85d13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e373f462-cbce-4d02-8a0b-b96fb6b005f9", "name": "network-vif-plugged", "status": "completed", "tag": "5f995ca5-5a2a-41de-8527-16927df2788a"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:09.398129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:06:09.398129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:06:09.409367 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-93cda589-f94f-4d0b-b90d-82420a69199f req-d880d66f-0101-4558-9867-84c47e85d13f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.410039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-93cda589-f94f-4d0b-b90d-82420a69199f req-d880d66f-0101-4558-9867-84c47e85d13f service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.413140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:09.423053 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:09.424307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-93cda589-f94f-4d0b-b90d-82420a69199f req-d880d66f-0101-4558-9867-84c47e85d13f service nova] Creating event network-vif-plugged:5f995ca5-5a2a-41de-8527-16927df2788a for instance e373f462-cbce-4d02-8a0b-b96fb6b005f9 on hv-cinder-81757 Nov 19 15:06:09.424564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:09.426045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c472e8e9-02e8-4184-9ce7-7382c3747099 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.231232 Nov 19 15:06:09.426667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 245/415] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:09 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:09.439496 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-93cda589-f94f-4d0b-b90d-82420a69199f req-d880d66f-0101-4558-9867-84c47e85d13f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049085 Nov 19 15:06:09.440148 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 171/416] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:06:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:09.825592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:09.826726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:09.832868 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.833315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:09.834124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:09.834556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:10.061324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-182d6adf-913f-4d60-8dba-504e0a27fcc0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 14 microversion: 2.1 time: 0.238813 Nov 19 15:06:10.061980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 246/417] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:09 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:10.109039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:10.109728 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:10.115762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:10.116204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:10.117000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:10.117440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:10.250547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:10.257733 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67b81b7c-f035-4ebf-b5fe-d87520b5979e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.153151 Nov 19 15:06:10.258289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 172/418] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:10 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:10.446565 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:10.447258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:10.454183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:10.454633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:10.455411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:10.455848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:10.584928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:10.594287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:10.595773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:10.596970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f0325fe0-d778-4758-845d-7d977da21085 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.154548 Nov 19 15:06:10.597519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 247/419] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:10 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:11.071158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:11.072064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:11.078936 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.079387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.080156 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.080590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.276424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:11.276981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:11.283330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.283759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.284528 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.284998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.418735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:11.426269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-53389415-c4fd-4f54-9d5f-046787051f24 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.153524 Nov 19 15:06:11.426818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 248/420] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:11 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:11.615552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:11.616200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:11.622371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.622828 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.624371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:11.624819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:11.755967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:11.763993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:11.765526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:11.766664 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a9dbfef7-39bd-459c-a9f4-f3279f56dc4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.154872 Nov 19 15:06:11.767196 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 249/421] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:11 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:12.442575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:12.443320 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:12.449594 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:12.450042 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:12.450825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:12.451905 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:12.584224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:12.591613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2cc495e8-d140-4099-8b64-5ef8fb947058 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.152898 Nov 19 15:06:12.592545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 250/422] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:12 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:12.784949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:12.785555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:12.791352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:12.791802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:12.792561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:12.793026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:12.922995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:12.931773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:12.933630 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:12.934850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b2e92227-d923-4771-9eb5-2273079830de tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.153864 Nov 19 15:06:12.935936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 251/423] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:12 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:13.330313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1ca3e44f-68d0-4d55-b8fd-d8070d446cce tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 15839 microversion: 2.1 time: 2.262521 Nov 19 15:06:13.330969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 173/424] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:11 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 15839 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:13.610996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:13.611711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:13.618179 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:13.618629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:13.619458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:13.620138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:13.753022 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:13.760274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-35037616-2d1b-46d4-b531-4dab42a7ec3d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1318 microversion: 2.1 time: 0.154573 Nov 19 15:06:13.760993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 252/425] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:13 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:13.954362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:13.954969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:13.961964 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:13.962458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:13.963305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:13.963745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:14.099575 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:14.107135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:14.108700 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:14.109840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7c310212-5905-4e46-952f-d2697072d413 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.160202 Nov 19 15:06:14.110388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 174/426] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:13 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:14.342826 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:14.343745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:14.349676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:14.350119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:14.350886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:14.351316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:14.454371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-584ca21c-ed6f-4060-a401-f2172d157c1f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 17602 microversion: 2.1 time: 0.116088 Nov 19 15:06:14.454999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 253/427] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:14 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 17602 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:14.777657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:14.778382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:14.784680 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:14.785166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:14.785944 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:14.786378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:14.955664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:14.963207 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82619490-7afb-4622-9515-ec38a1c87bdd tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1508 microversion: 2.1 time: 0.189242 Nov 19 15:06:14.964080 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 175/428] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:14 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:15.128385 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:15.129186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:15.136756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:15.137284 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:15.138060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:15.138535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:15.466480 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:15.467931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:15.469608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:15.474304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:15.474759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:15.475550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:15.475995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:15.477154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:15.478632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:15.479772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b76745f1-bf0c-44a8-b08f-22c486074b56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.355552 Nov 19 15:06:15.480313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 254/429] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:15 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:15.561443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e08d8ab-8d9a-4b33-95ab-45fe90b318d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 17602 microversion: 2.1 time: 0.098094 Nov 19 15:06:15.562301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 176/430] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:15 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 17602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:16.270922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dff42f8-1dad-4c19-b805-ac44e4fe10ff"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:16.271981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:16.279126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.279933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.280807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.281284 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.500017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:16.500712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:16.507883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.508340 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.509345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.509791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.627533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-17c0a977-6cbc-4226-a382-5bb6d5474b88 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360137 Nov 19 15:06:16.628545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 255/431] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:06:16 2021] POST /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:06:16.633798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:16.635249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:16.643001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.643706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.644920 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:16.645574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:16.666447 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:16.675171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:16.676938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:16.678451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed9762c7-275a-4b79-b0e5-0c8b5fb3f538 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.182611 Nov 19 15:06:16.679258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 177/432] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:16 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:16.738248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4969ca4c-551e-45b2-bcf3-e93e0787ad8e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 19446 microversion: 2.1 time: 0.108070 Nov 19 15:06:16.738883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 256/433] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:16 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 19446 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:17.696764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:17.697393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:17.703786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:17.704289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:17.705088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:17.705521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:17.750988 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:17.757106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:17.764854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:17.765319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:17.766125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:17.766595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:17.837617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:17.846489 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:17.848018 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:17.849384 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2e467c84-cebe-4fc3-a54e-a1b8163ec191 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.156178 Nov 19 15:06:17.860097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 178/434] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:17 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:18.879091 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:18.879677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:18.885937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:18.886419 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:18.887169 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:18.887606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:19.019002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:19.026464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:19.027932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:19.029726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1ca13aca-4364-4be2-991d-20f71cec6910 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.153962 Nov 19 15:06:19.030275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 179/435] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:18 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:20.046508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:20.047111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:20.053298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:20.053744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:20.054512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:20.054941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:20.320612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:20.329167 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:20.330655 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:20.331793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-099d535c-dba8-448f-b53f-320330f58e73 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.289062 Nov 19 15:06:20.332336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 180/436] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:20 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:20.705945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-129534cf-85b5-4776-b389-0c4b5c696e05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 24044 microversion: 2.1 time: 2.959725 Nov 19 15:06:20.707309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 257/437] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:17 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 24044 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:21.359338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:21.375231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:21.388215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:21.388762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:21.390540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:21.391499 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:21.542920 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:21.550734 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:21.552215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:21.553394 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1c24009-7d0d-4d5a-b10f-369d93a4145c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.206611 Nov 19 15:06:21.554336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 181/438] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:21 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:21.719992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:21.721481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:21.728651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:21.729143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:21.729987 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:21.730470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:21.857669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-486372a9-c6f1-4f2f-9cf9-aec87bd5a294 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 24500 microversion: 2.1 time: 0.143323 Nov 19 15:06:21.858336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 258/439] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:21 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 24500 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:22.135686 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:22.136697 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:22.142846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.143315 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.144100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.144544 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.166938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'flavor' on Instance uuid d257632a-adba-4ac6-8dd4-1be8485c24a7 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:06:22.290672 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1966f192-701c-4141-8eac-8d6b3873cf7f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action" status: 200 len: 32 microversion: 2.1 time: 0.158616 Nov 19 15:06:22.291192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 182/440] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:22 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:22.300961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:22.301661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:22.308844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.309314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.310171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.311198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.448005 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:22.457095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-359bf86f-77f3-4caa-aa60-c0bf6278d696 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.159983 Nov 19 15:06:22.457662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 259/441] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:22 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:22.573878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:22.574578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:22.580616 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.581105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.581885 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.582329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.711504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:22.719992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:22.721507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:22.722671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cfe5eee9-49d4-4266-b699-25103cc57ee3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.153408 Nov 19 15:06:22.723214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 183/442] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:22 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:22.868898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:22.869811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:22.876208 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.876653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:22.877466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:22.877899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:23.475162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:23.475805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:23.481739 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:23.482186 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:23.483282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:23.483808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:23.623441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:23.631061 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f2ce3da-b17c-4a6f-a742-1690d48eac58 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.160217 Nov 19 15:06:23.631606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 184/443] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:23 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:23.740370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:23.740959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:23.746841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:23.747295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:23.748300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:23.749146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:23.879999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:23.887904 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:23.889992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:23.891143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-848a567f-2797-49a3-8c15-642ec877efbd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.154432 Nov 19 15:06:23.891734 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 185/444] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:23 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:24.648960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:24.649594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:24.655896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:24.656339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:24.657162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:24.657598 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:24.790110 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:24.799625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a999491c-5df5-4054-8174-af2b7e9950fe tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.153954 Nov 19 15:06:24.800335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 186/445] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:24 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:24.910602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:24.911304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:24.917236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:24.917684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:24.918452 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:24.918883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:25.045824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:25.053936 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:25.055436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:25.056585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1951ef60-741e-4095-9f2d-c1e657c2d3bf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.149669 Nov 19 15:06:25.057163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 187/446] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:24 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:25.535555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1af60def-3e80-40f2-b1c6-4881e9874267 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 26907 microversion: 2.1 time: 2.670094 Nov 19 15:06:25.537650 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 260/447] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:22 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 26907 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:25.816552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:25.817803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:25.824332 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:25.824808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:25.825617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:25.826580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:26.075226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:26.075991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:26.083030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:26.083487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:26.084287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:26.084736 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:26.141979 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:26.152421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a36f8c15-2f2c-4dca-a096-d638bfa5b33e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.339787 Nov 19 15:06:26.163590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 188/448] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:25 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:26.235050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:26.243456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:26.244989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:26.246129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b8e770c5-4434-457e-bcd7-e0badd9d24fb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.175129 Nov 19 15:06:26.246667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 261/449] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:26 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:26.547612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:26.548493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:26.554288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:26.554734 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:26.555506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:26.555945 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:26.660257 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9eb9e75-573e-4a25-a62b-059add8e6e8d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 27360 microversion: 2.1 time: 0.116859 Nov 19 15:06:26.661274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 189/450] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:26 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 27360 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:27.172312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:27.172957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:27.179814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.180261 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.181088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.181523 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.267159 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:27.267980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:27.293658 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.294293 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.295643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.296294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.324233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:27.338169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4ed63c9b-0bbb-48c6-b216-2a7ac6136124 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.170292 Nov 19 15:06:27.339543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 262/451] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:27 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:27.443664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:27.452075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:27.453662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:27.454813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78857c0a-c734-4d4c-a4fb-e845f6647a39 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1742 microversion: 2.20 time: 0.193674 Nov 19 15:06:27.455365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 190/452] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:27 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:27.673260 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:27.674234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:27.680472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.680954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.681731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:27.682264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:27.774044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c94f36d3-9f75-478d-90f1-3956fbd05097 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 27848 microversion: 2.1 time: 0.106036 Nov 19 15:06:27.775322 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 263/453] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:27 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 27848 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:28.355041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:28.355651 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:28.362437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.362891 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.363679 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.364282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.474497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:28.475210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:28.482033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.483074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.483910 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.484352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.501655 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:28.509386 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65134983-3636-4163-a1c9-8fe36232b739 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.158028 Nov 19 15:06:28.509949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 191/454] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:28 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:28.614491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:28.622766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:28.624499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:28.625748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bb8015c7-6fc9-4fda-a292-d5542a69760b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1742 microversion: 2.20 time: 0.155393 Nov 19 15:06:28.626382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 264/455] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:28 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:28.786726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:28.787643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:28.793805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.794297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.795315 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:28.795804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:28.890631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a9927912-8819-42bc-927e-d00319f7009d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28002 microversion: 2.1 time: 0.107494 Nov 19 15:06:28.894471 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 192/456] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:28 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28002 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:29.387641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-d2c73503-cbca-490e-9efb-ce1e80897729 req-c8bd0ef6-6352-4f02-b337-7a3037953924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "name": "network-vif-plugged", "status": "completed", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:29.389651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:06:29.389651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:06:29.397639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d2c73503-cbca-490e-9efb-ce1e80897729 req-c8bd0ef6-6352-4f02-b337-7a3037953924 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.398325 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d2c73503-cbca-490e-9efb-ce1e80897729 req-c8bd0ef6-6352-4f02-b337-7a3037953924 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.413944 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-d2c73503-cbca-490e-9efb-ce1e80897729 req-c8bd0ef6-6352-4f02-b337-7a3037953924 service nova] Creating event network-vif-plugged:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:06:29.418667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-d2c73503-cbca-490e-9efb-ce1e80897729 req-c8bd0ef6-6352-4f02-b337-7a3037953924 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035381 Nov 19 15:06:29.419266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 265/457] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:06:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:29.527430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:29.528763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:29.543319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.544410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.545944 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.546394 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.645665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:29.646370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:29.656890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.657348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.658227 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.658595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.715556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:29.726650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3c67d92-8ce1-4652-839a-9dde8345b760 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.204472 Nov 19 15:06:29.727234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 193/458] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:29 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:29.799886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:29.807898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:29.809579 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:29.811594 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7e5280bc-ec92-4af9-ace1-9b3d3c163492 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1742 microversion: 2.20 time: 0.170751 Nov 19 15:06:29.812224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 266/459] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:29 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:29.901870 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:29.902819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:29.909305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.909747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:29.910529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:29.910963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:30.028412 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3dd18781-2358-4d16-9af8-752650bdf9af tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28064 microversion: 2.1 time: 0.130054 Nov 19 15:06:30.029176 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 194/460] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:29 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28064 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:30.745753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:30.747046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:30.755526 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:30.756053 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:30.756979 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:30.757573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:30.831896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:30.832699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:30.842392 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:30.843409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:30.844306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:30.845275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:30.928051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:30.937376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dd899f11-a3be-4dc4-86e9-803ad9653446 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.195640 Nov 19 15:06:30.937883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 267/461] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:30 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:31.034779 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:31.042133 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:31.043182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:31.045399 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:31.047804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:31.049086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a6fd5ed-af2a-4e07-afc3-d7334a57bb88 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.222629 Nov 19 15:06:31.057273 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 195/462] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:30 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:31.058345 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.059169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:31.060137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.061493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:31.178800 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e4d98ded-212a-495c-9e53-a85d5b3f78aa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28184 microversion: 2.1 time: 0.142480 Nov 19 15:06:31.180476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 268/463] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:31 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28184 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:31.927237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7716848-84da-41ca-a698-6e5644867180", "device": "/dev/sdb"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:31.934124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:31.942258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.942918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:31.943879 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.944467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:31.968761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:31.979823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:31.988283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.989004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:31.989982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:31.995064 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:32.287314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:32.297443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f32c2e8c-1958-498b-bdbd-a9b271dc0af2 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.344953 Nov 19 15:06:32.308824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 269/464] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:31 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:32.316176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:32.317270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:32.325486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:32.326173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:32.327799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:32.329700 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:32.432430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-10777084-c7c0-4467-97aa-b57ca2c6b6ab tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "POST /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522499 Nov 19 15:06:32.455639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 196/465] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:06:31 2021] POST /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:32.462393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:32.465749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:32.475512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:32.477279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:32.478318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:32.478915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:32.628980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6c987e5-aecb-4a15-be23-c38cc8e1578a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28184 microversion: 2.1 time: 0.171291 Nov 19 15:06:32.629632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 197/466] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:32 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:32.648322 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:32.665074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:32.666884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:32.668578 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b3102f2b-9669-499d-9592-819e3ed1784e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.358395 Nov 19 15:06:32.670601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 270/467] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:32 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:33.315349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:33.316842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:33.323670 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.324125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.324976 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.325588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.562917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:33.572951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3d565e5f-f341-4cc7-9f19-46da8f31e394 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.261631 Nov 19 15:06:33.574131 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 198/468] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:33 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:33.643238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:33.644233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:33.657281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.657744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.658648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.658988 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.688995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:33.689623 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:33.707078 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.707556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.708359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:33.708822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:33.861044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3c9962bb-af27-4599-8703-ada33a392172 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28184 microversion: 2.1 time: 0.224110 Nov 19 15:06:33.865433 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 271/469] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:33 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:33.958321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:33.979606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:33.991536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:33.995483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f703011a-b456-4b7f-aae4-f20fcef22c9e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.309392 Nov 19 15:06:34.000847 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 199/470] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:33 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:34.070830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dff42f8-1dad-4c19-b805-ac44e4fe10ff"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:34.072486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:34.080489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.081368 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.082531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.083982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.204099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Invalid volume: volume 0dff42f8-1dad-4c19-b805-ac44e4fe10ff is already attached to instances: e373f462-cbce-4d02-8a0b-b96fb6b005f9 Nov 19 15:06:34.205108 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 400 to user: Invalid volume: volume 0dff42f8-1dad-4c19-b805-ac44e4fe10ff is already attached to instances: e373f462-cbce-4d02-8a0b-b96fb6b005f9 {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:06:34.206172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f328c8d-303e-45ea-af5f-d5360e618f61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.141555 Nov 19 15:06:34.207493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 272/471] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:06:34 2021] POST /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:06:34.274762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:34.275366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:34.283485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.284202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.285248 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.285897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.446914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lazy-loading 'services' on Instance uuid e373f462-cbce-4d02-8a0b-b96fb6b005f9 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:06:34.608679 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:34.609862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:34.617315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.626112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.626961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.631877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.716732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-667e52d5-98bf-4309-8918-35d0c256247c tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments/0dff42f8-1dad-4c19-b805-ac44e4fe10ff" status: 202 len: 0 microversion: 2.1 time: 0.446181 Nov 19 15:06:34.725896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 200/472] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:06:34 2021] DELETE /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments/0dff42f8-1dad-4c19-b805-ac44e4fe10ff => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:06:34.740459 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:34.743095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:34.765804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.767838 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.769625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.771037 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.856151 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ed5c876-0285-434e-8e49-628f1dd350f1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125898 Nov 19 15:06:34.856723 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 201/473] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:34 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:34.873231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:34.874583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:34.881613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.882995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.884040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:34.884696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:34.962224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:34.972641 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3203e90-80c7-4b24-87f8-a54d81031b7a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28184 microversion: 2.1 time: 0.103393 Nov 19 15:06:34.977586 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 202/474] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:34 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:34.981112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-14e4be91-410b-4856-aa50-9d5197ae4578 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.382162 Nov 19 15:06:34.982359 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 273/475] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:34 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:35.019249 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:35.020014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:35.027180 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:35.027845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:35.028934 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:35.029637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:35.227888 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:35.236974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:35.239385 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:35.245011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d64fa4a-f3b4-46cd-97a9-ab99e57785eb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.230761 Nov 19 15:06:35.245652 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 203/476] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:35 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:35.870966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:35.876195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:35.895150 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:35.899165 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:35.902991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:35.905232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:35.956327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-62676dde-f145-4113-b6e7-e67599372ca5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092235 Nov 19 15:06:35.957543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 274/477] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:35 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:35.984260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:35.986660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:36.004037 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.005235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.006333 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.007152 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.016364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:36.020342 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:36.030235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.031424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.032256 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.032702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.087858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3fbe17f-e26c-4816-8a55-92953afc1193 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28184 microversion: 2.1 time: 0.107311 Nov 19 15:06:36.089190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 204/478] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:35 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28184 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:36.268255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:36.270526 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:36.279189 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:36.280177 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e235a819-fba8-4dc0-a000-54732fb6e951 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.281073 Nov 19 15:06:36.285027 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 275/479] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:35 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:36.308645 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.313348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.317076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.318113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.584481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:36.627694 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:36.631763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:36.633891 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a287d9f0-eb2d-47af-b3a9-86a94a32092e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.371397 Nov 19 15:06:36.634978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 205/480] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:36 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:36.968128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:36.969290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:36.975776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.976427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:36.977250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:36.977847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.019556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fba33f74-ec1b-4813-8cc8-1c4a17201ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055509 Nov 19 15:06:37.026021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 276/481] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:36 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:37.101212 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:37.102215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:37.115602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.116061 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.116919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.117523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.231620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed6a08ca-0468-4798-b250-0465362aaf2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28474 microversion: 2.1 time: 0.133708 Nov 19 15:06:37.233557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 206/482] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:37 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28474 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:37.301926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:37.302746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:37.309402 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.310174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.311161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.311751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.559315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:37.576608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4d73ba6e-5b16-4b60-81e3-1e0276e471f9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.278896 Nov 19 15:06:37.577880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 277/483] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:37 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:37.664177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:37.667126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:37.698215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.702069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.703064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:37.704684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:37.967494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:37.976823 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:37.978724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:37.980085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ca90f72-c2de-4842-a7a7-7242c660e728 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.330875 Nov 19 15:06:37.991669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 207/484] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:37 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:38.032342 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:38.033313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:38.047882 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.048336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:38.049176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.049618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:38.201713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b9dea033-f1f1-4c58-90a0-6bea6467ea13 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174266 Nov 19 15:06:38.206765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 278/485] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:38 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:38.244769 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:38.246617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:38.258093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.261022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:38.262016 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.263834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:38.385211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-128a4aa6-872c-4971-a552-b1aaf920fb42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28536 microversion: 2.1 time: 0.144548 Nov 19 15:06:38.385921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 208/486] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:38 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28536 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:38.594239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:38.594852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:38.612776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.613875 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:38.614695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:38.615135 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.003528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:39.005881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:39.025459 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.026306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.027434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.028059 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.034221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:39.053143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4a1ae4f7-e4eb-4fdf-be87-7cd34dbca4d9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.462940 Nov 19 15:06:39.054080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 279/487] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:38 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:39.214876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:39.216112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:39.230611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.233599 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.234621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.235211 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.276694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5a6a329b-07b1-4d88-acb5-f83a7ac4e6b0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066923 Nov 19 15:06:39.278612 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 280/488] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:39 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:06:39.352026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:39.365738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:39.367593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:39.369152 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8be90c31-7195-4576-aa23-624bfaab2e02 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.372931 Nov 19 15:06:39.370188 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 209/489] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:38 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:39.398351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:39.399250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:39.409155 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.409929 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.410917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:39.411549 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:39.518719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-24e1f7d9-885e-44d9-a3ff-54351ec3189b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.124016 Nov 19 15:06:39.520352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 281/490] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:39 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:40.074385 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:40.075210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:40.095649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.100321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.101654 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.102258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.291336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:40.305238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:40.347434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.353842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.355260 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.358151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.531179 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-041cf08c-aaeb-4288-a926-b44d26d89c89 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243896 Nov 19 15:06:40.532404 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 282/491] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:40 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:40.540505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:40.546167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:40.571202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.572449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.577608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.578492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.753583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:40.765554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7548f542-e97f-43c1-a806-cfd9349031a0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.695110 Nov 19 15:06:40.769745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 210/492] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:40 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:40.782703 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:40.783901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:40.800456 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.800934 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.804359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:40.806809 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:40.925646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8ca4d47a-c5f0-4a06-bc96-0638db2354ec tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.153839 Nov 19 15:06:40.926365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 211/493] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:40 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:41.015429 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:41.023580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:41.025101 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:41.026268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-18bfec14-2dda-4906-bb05-23348a2a23f5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.492698 Nov 19 15:06:41.026820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 283/494] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:40 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:41.548164 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:41.549941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:41.578635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.579514 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:41.590049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.592124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:41.695583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-25cf08f3-a2d1-4ae0-997f-d0627c5dee1d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154114 Nov 19 15:06:41.697331 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 212/495] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:41 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:41.787212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:41.787825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:41.796413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.796949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:41.798003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.798506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:41.939460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:41.941196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:41.976264 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.977413 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:41.981288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:41.983637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:42.101783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:42.117493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-66afd05d-f04e-4d30-a530-62a098b987fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.182499 Nov 19 15:06:42.118144 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 213/496] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:41 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:42.125655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6aedb27c-a05b-447f-8ad2-c2430e97c10d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.341980 Nov 19 15:06:42.126087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:42.126855 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 284/497] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:41 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:42.127398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:42.134666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:42.135112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:42.135902 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:42.136332 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:42.398295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:42.409244 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:42.413724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:42.418039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f6294004-b93c-4249-b421-8dd7be7aaeb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.297710 Nov 19 15:06:42.419684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 214/498] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:42 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:42.709815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:42.711710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:42.724907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:42.725675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:42.733636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:42.735284 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:42.830393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4e40f549-992b-4748-9be7-1bf0a92c4b65 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126095 Nov 19 15:06:42.834904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 285/499] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:06:42 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:06:43.050141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-131475168", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "cd986946-8454-44e7-80e5-6d3c5bfe30eb"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:43.130584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] validate_networks() for [('cd986946-8454-44e7-80e5-6d3c5bfe30eb', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:06:43.130729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:43.131697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:43.142919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.143680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:43.144694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.145160 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:43.695468 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:06:43.697028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:06:43.698180 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:06:43.698851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:06:43.699894 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:06:43.713384 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.714626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:43.715949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.716442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:43.754765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:06:43.762763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Getting quotas for user ba4aff19ddd54325b884984bb6ddc144 and project 53995b55564a4b2784260772caeedf05. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:06:43.787117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:06:43.790149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:06:43.865021 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b5d6f77c-dc00-4e08-9136-9e34f130e0fb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801215 Nov 19 15:06:43.866320 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 215/500] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:06:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:06:43.877471 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:43.878365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:43.920329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.921068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:43.926484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:43.927183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:44.270839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:44.282245 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-72a9f6d0-43fe-498d-8aac-5950e72c23df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.414619 Nov 19 15:06:44.292708 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 216/501] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:43 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:44.299588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:44.300514 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:44.310408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:44.311217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:44.314323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:44.315028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:44.528178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:44.537980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:44.548171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:44.549762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3a839455-445e-499a-a588-0dc8f020f3a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.255637 Nov 19 15:06:44.552905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 217/502] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:44 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:44.564722 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:44.565504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:44.582759 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:44.583218 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:44.584026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:44.584465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:44.695572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:44.706991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a80b9e32-ddd1-42cd-a3fa-19ed95a0409b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1221 microversion: 2.1 time: 0.151988 Nov 19 15:06:44.708577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 218/503] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:44 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:45.300012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:45.300915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:45.307035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cd266164-0947-47e4-85b2-eb3382d36676 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 2.180004 Nov 19 15:06:45.307756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 286/504] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:43 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:45.314705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.315110 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:45.322419 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.323153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:45.574354 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:45.580210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:45.595209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.596832 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:45.599569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.608944 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:45.882526 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:45.892752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4f6d655-6657-449b-8a37-b47dfbf7c972 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.596357 Nov 19 15:06:45.907497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 219/505] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:45 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:45.913701 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:45.915278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:45.923334 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.924069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:45.925107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:45.926492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:46.042274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:46.052289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3997f1d0-81c5-4c33-846e-ca3ae2b38606 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1269 microversion: 2.1 time: 0.143300 Nov 19 15:06:46.052907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 220/506] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:45 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:46.176086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:46.191762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:46.198009 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:46.206747 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f9b5c7f-5994-413f-ba60-8f975f87f88e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.636118 Nov 19 15:06:46.208182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 287/507] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:45 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:46.320201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:46.321864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:46.343629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:46.348440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:46.349758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:46.350403 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:46.518874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb356b5e-affb-4529-b593-ace701148d05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.202050 Nov 19 15:06:46.523005 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 221/508] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:46 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:46.913550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:46.914780 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:46.928193 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:46.930404 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:46.931167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:46.931781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.069967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:47.070660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:47.094860 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.101717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.102670 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.103124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.223060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:47.232617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cc2cdfb5-93ad-430b-82e9-c7317e837255 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.322565 Nov 19 15:06:47.242003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 288/509] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:46 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:47.256350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:47.257964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:47.273282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.273981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.276675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.277420 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.569278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:47.596617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb74f589-3033-4d38-ae08-fc39a06e8ccf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1275 microversion: 2.1 time: 0.522779 Nov 19 15:06:47.597366 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:47.599556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 222/510] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:47 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1275 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:47.606086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:47.608003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:47.618373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:47.620164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:47.621527 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-48687b8c-1b89-4223-a7d3-b6a5778baafa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.377676 Nov 19 15:06:47.623980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.624714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.625918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:47.626511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:47.635686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 289/511] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:47 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:48.252358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:48.253975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:48.265698 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.266367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:48.268448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.269067 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:48.517598 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:48.531970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-be0dfed4-0659-4f69-b83e-4365403fec6e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.284608 Nov 19 15:06:48.533364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 290/512] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:48 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:48.618356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:48.621567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:48.630135 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.630589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:48.631724 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.633160 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:48.849310 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:48.856846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0c339f6a-0a79-4b03-8656-2e0b4e57c314 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.244136 Nov 19 15:06:48.869530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 291/513] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:48 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:48.875092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:48.876148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:48.884340 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.885071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:48.886092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:48.886676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:49.069113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:49.082503 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:49.085435 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:49.089466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8dd6614a-3d87-4aa1-b9dc-2a8d93bf93ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.217320 Nov 19 15:06:49.105029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 292/514] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:48 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:49.550877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:49.551638 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:49.558005 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:49.558720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:49.560702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:49.561316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:49.736659 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:49.748658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3bcf685b-420d-45d6-b7db-4f3187bdbb0f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.200909 Nov 19 15:06:49.759646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 293/515] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:49 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:49.875595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:49.876204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:49.882389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:49.882841 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:49.883634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:49.884253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.016328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:50.023556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-82bc49a6-5521-4ab5-a76d-4ca2bab9363e tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.152300 Nov 19 15:06:50.024416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 294/516] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:49 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:50.103932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cd97d093-54c9-4409-8af1-b2f535e71aa7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 2.502736 Nov 19 15:06:50.113055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:50.114234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:50.117140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 223/517] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:47 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:50.125541 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:50.131811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.133697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:50.136010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.382324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:50.392481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:50.395201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:50.396689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2dde0d84-acf8-4140-bf5e-55c0b4e1530d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1737 microversion: 2.20 time: 0.288369 Nov 19 15:06:50.404221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 295/518] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:50 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:50.767472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:50.768182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:50.775786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:50.776244 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.795182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:50.795750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.935610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-9a65d8b2-baed-48d8-be8b-7f6b76400a14 req-aa077d5e-194b-4db2-93e8-4902854dcf02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a63773-fdbd-42f4-902a-e7a239352c74", "tag": "7ecc0bd1-97ba-44d6-9936-ad1121a6f143"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:50.938220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:06:50.938220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:06:50.949621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9a65d8b2-baed-48d8-be8b-7f6b76400a14 req-aa077d5e-194b-4db2-93e8-4902854dcf02 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:50.950381 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9a65d8b2-baed-48d8-be8b-7f6b76400a14 req-aa077d5e-194b-4db2-93e8-4902854dcf02 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:50.965707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-9a65d8b2-baed-48d8-be8b-7f6b76400a14 req-aa077d5e-194b-4db2-93e8-4902854dcf02 service nova] Creating event network-changed:7ecc0bd1-97ba-44d6-9936-ad1121a6f143 for instance 57a63773-fdbd-42f4-902a-e7a239352c74 on hv-cinder-81757 Nov 19 15:06:50.971949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-9a65d8b2-baed-48d8-be8b-7f6b76400a14 req-aa077d5e-194b-4db2-93e8-4902854dcf02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043742 Nov 19 15:06:50.973158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 296/519] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:06:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:51.044056 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:51.045327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:51.064771 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.066285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.067608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.068483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.266842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:51.275653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fcde7f54-a48b-484d-a627-fe2874d93eaf tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.238849 Nov 19 15:06:51.277835 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 297/520] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:51 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:51.290444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:51.291662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:51.301593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.302358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.303357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.303892 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.321957 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:51.341023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7fc9ff08-7f13-468d-ae83-27d8a91577a8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.578069 Nov 19 15:06:51.341906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 224/521] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:50 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:51.392408 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-06db4350-b3d7-4723-ad3b-e0ab46a40317 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.113079 Nov 19 15:06:51.396393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 298/522] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:51 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:51.416610 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:51.417631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:51.426671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.427462 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.428626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:51.429313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:51.678006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:51.686586 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:51.688301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:51.690041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2ee43e94-d8b8-4e68-8bb9-5658229d5b43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.278303 Nov 19 15:06:51.701683 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 225/523] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:51 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:52.294758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:52.296386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:52.310291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.311037 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.312197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.312839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.359699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:52.360376 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:52.366581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.371358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.371711 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.373348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.547562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:52.556243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f8f463c8-0a78-4da7-8374-44f3f902452b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.266028 Nov 19 15:06:52.557033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 299/524] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:52 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:52.573577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:52.575901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:52.582879 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.583744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.585308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.586173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.776244 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:52.785239 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c9dfec2-edce-4b05-b7dc-c48540988e10 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.430888 Nov 19 15:06:52.795991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 226/525] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:52 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:52.804745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:52.809593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:52.828688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.829268 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:52.830316 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:52.830962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:53.099772 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:53.110508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:53.112611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:53.116960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2ff7d9f3-4f40-4702-b94c-dcb1419baf3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.316827 Nov 19 15:06:53.117613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 227/526] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:52 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:53.572745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:53.576414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:53.583463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:53.584190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:53.585256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:53.585969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:53.742405 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:53.753024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67fbd469-af39-4f42-b789-1d3804274080 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.184163 Nov 19 15:06:53.753874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 228/527] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:53 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:53.802500 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:53.803768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:53.814883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:53.815370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:53.816362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:53.816915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:54.035107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:54.045533 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0d050454-4d6c-4607-a7c4-8cbdaa1ee144 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.246568 Nov 19 15:06:54.046113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 229/528] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:53 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:54.144464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:54.146106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:54.155799 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:54.156619 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:54.158039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:54.158697 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:54.373427 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:54.382265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:54.385878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:54.388212 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-264bc54d-2dc1-46bc-89a9-51613cc3ef71 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.255994 Nov 19 15:06:54.389801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 230/529] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:54 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:06:54.748775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7249b991-ba44-4234-9a29-7ffe36ef7b49 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 2.185431 Nov 19 15:06:54.758750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 300/530] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:52 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:54.771481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:54.772945 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:54.797543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:54.810650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:54.811546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:54.812007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.019079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-65b7931f-ea70-4e1b-864a-aae27ca0e1f4 req-c8b9b235-2612-4a4d-8d98-0fe1dfc80fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "name": "network-vif-unplugged", "status": "completed", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:55.019079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:06:55.019079 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:06:55.034043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-65b7931f-ea70-4e1b-864a-aae27ca0e1f4 req-c8b9b235-2612-4a4d-8d98-0fe1dfc80fae service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.034043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-65b7931f-ea70-4e1b-864a-aae27ca0e1f4 req-c8b9b235-2612-4a4d-8d98-0fe1dfc80fae service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.061820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-65b7931f-ea70-4e1b-864a-aae27ca0e1f4 req-c8b9b235-2612-4a4d-8d98-0fe1dfc80fae service nova] Creating event network-vif-unplugged:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:06:55.066922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-65b7931f-ea70-4e1b-864a-aae27ca0e1f4 req-c8b9b235-2612-4a4d-8d98-0fe1dfc80fae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062837 Nov 19 15:06:55.068064 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 301/531] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:06:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:06:55.073308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:55.074436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:55.081961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.082842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.083892 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.084552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.157404 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:55.167861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-be84003a-6bef-4681-9458-1d88c83b0533 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.399890 Nov 19 15:06:55.180252 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 231/532] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:54 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:55.316370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:55.328095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-92cc6bf6-c7c0-464c-9930-7117b20f509c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.258523 Nov 19 15:06:55.329003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 302/533] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:55 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:55.416427 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:55.417076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:55.432317 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.432688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.433548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.434014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.763917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:55.765630 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:55.771059 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:55.773440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.773899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.775098 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:55.775545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:55.780877 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:55.786049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:55.788618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-87d825e9-7785-473c-8466-c7f5872e8066 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.382355 Nov 19 15:06:55.800490 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 232/534] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:55 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:55.880760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3f8ee23c-ba75-451d-b7c4-ea711d8b0505 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.120797 Nov 19 15:06:55.887442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 303/535] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:55 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:56.184917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:56.185522 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:56.191774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.192225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.193047 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.193716 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.346695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:56.347543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:56.357648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.359234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:56.361323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.362625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.363224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.367246 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9229ca9d-2314-41db-ba60-f83e73899802 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.185882 Nov 19 15:06:56.368416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 233/536] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:56 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:56.557130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:56.566594 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0d1369dd-cf5f-4c16-9e1a-c15a8cabf7ce tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.224228 Nov 19 15:06:56.567380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 304/537] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:56 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:06:56.808194 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:56.809000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:56.816401 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.817264 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.818366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.818970 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.895059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:56.896624 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:56.908141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.911272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.912492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:56.913112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:56.973582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:56.983166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:56.984746 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:56.986154 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c462a629-c7d1-4119-9c11-ef3e92d8e5a0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.182178 Nov 19 15:06:56.986890 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 234/538] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:56 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:57.016034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0a4a5b39-e4db-4f49-aa84-48c2dae49012 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28641 microversion: 2.1 time: 0.125005 Nov 19 15:06:57.020438 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 305/539] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:56 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28641 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:57.383115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:57.383878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:57.390324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:57.390976 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:57.391763 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:57.392199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:57.530227 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:57.538070 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9127b8b4-99a2-4c04-92c3-76767e2838d7 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.158543 Nov 19 15:06:57.540152 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 235/540] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:57 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:57.585306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:57.587698 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:57.597637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:57.598176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:57.599055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:57.599572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:57.769129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:57.777823 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-53ea10b1-b2cc-4420-818b-4ad02ba2ac3c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1568 microversion: 2.1 time: 0.196589 Nov 19 15:06:57.778615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 306/541] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:57 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:58.006620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:58.007966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:58.016014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.016768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.017604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.018046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.032573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:58.034572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:58.042800 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.043799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.044993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.045734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.163803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-587630c4-963f-403d-95db-6926b713a809 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 28760 microversion: 2.1 time: 0.139633 Nov 19 15:06:58.165306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 307/542] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:58 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 28760 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:06:58.200490 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:58.211786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:58.213853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:58.215205 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4ad31d5a-75ac-44a8-9c6e-782f09631712 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1719 microversion: 2.20 time: 0.214062 Nov 19 15:06:58.216782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 236/543] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:57 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:58.557641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:58.562436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:58.570375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.570826 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.571614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.572047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.733874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:58.735820 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:58.745234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.748086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.751442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.753411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.771654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:58.780034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ad13aeba-62d4-418f-9e1e-e9df91382fee tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.227967 Nov 19 15:06:58.789807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 308/544] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:58 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:58.799794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:58.800638 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:58.807052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.808067 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.808202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:58.813604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:58.892767 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lazy-loading 'services' on Instance uuid 2844a016-6b31-4f81-9afe-1b39957cbfe0 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:06:58.971846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:58.981908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2a2adf77-5560-48a0-88b1-68573fb8225c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1548 microversion: 2.1 time: 0.188248 Nov 19 15:06:58.993229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 309/545] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:58 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:58.998901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:58.999438 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.005273 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e3ce3013-d93c-42a3-bc41-537756ff2399 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0/os-volume_attachments/b7716848-84da-41ca-a698-6e5644867180" status: 202 len: 0 microversion: 2.1 time: 0.266886 Nov 19 15:06:59.005710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.006371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.007347 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.008023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.011403 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 237/546] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:06:58 2021] DELETE /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0/os-volume_attachments/b7716848-84da-41ca-a698-6e5644867180 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:06:59.168161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] HTTP exception thrown: Cannot 'detach_volume' instance d257632a-adba-4ac6-8dd4-1be8485c24a7 while it is in vm_state rescued Nov 19 15:06:59.170625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Returning 409 to user: Cannot 'detach_volume' instance d257632a-adba-4ac6-8dd4-1be8485c24a7 while it is in vm_state rescued {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:06:59.170625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-33c7fbb4-cb64-41d1-bdd7-77678fe36c85 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments/ea147ac8-d149-4aab-ab48-0b8d5c3aabf4" status: 409 len: 152 microversion: 2.1 time: 0.175184 Nov 19 15:06:59.179847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 310/547] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:06:58 2021] DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments/ea147ac8-d149-4aab-ab48-0b8d5c3aabf4 => generated 152 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 19 15:06:59.180715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:59.181804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.185003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:59.185814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.192849 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.193046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.193321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.193836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.194112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.194546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.195138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.195749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.277309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c8ea02f1-11f9-4718-a415-fa4328164e19 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action" status: 202 len: 0 microversion: 2.1 time: 0.096263 Nov 19 15:06:59.279867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 311/548] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:59 2021] POST /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:06:59.285491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:59.286379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.292617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.293109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.294041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.294806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.303436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0cdb743b-a775-47cf-882a-7ef130d91e2b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 30163 microversion: 2.1 time: 0.129650 Nov 19 15:06:59.304935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 238/549] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:06:59 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 30163 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:06:59.312610 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:59.313674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.323707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.324681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.326534 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.327303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.471454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:59.483283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:59.485329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:59.488087 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a6786e98-dcb7-4a99-a537-c886816ef152 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1662 microversion: 2.20 time: 0.206586 Nov 19 15:06:59.490949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 312/550] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:06:59 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1662 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:06:59.510697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9590d674-9e3a-4d29-aea4-93657ea85b8d"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:06:59.512148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.519051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.519754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.520730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.521348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.874378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:06:59.885037 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-54ec8208-9772-4a95-956f-d100d073c6f5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1556 microversion: 2.1 time: 0.578680 Nov 19 15:06:59.885712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 239/551] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:59 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1556 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:06:59.891956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:06:59.894746 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:06:59.909197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.909713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.911348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:06:59.913082 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:06:59.993219 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-52f87de1-fbe3-4bc2-b8cf-87d376f98b57 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.486320 Nov 19 15:06:59.995749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 313/552] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Nov 19 15:06:59 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments => generated 188 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:07:00.177544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:00.179018 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.206510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.206988 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.207790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.208236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.242643 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:00.265178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:00.275338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b7496d7-0659-42b7-9b35-620791c173ea tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.385721 Nov 19 15:07:00.276738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 240/553] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:06:59 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:00.281493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:00.282063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.290609 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.291524 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.292708 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.293413 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.375998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b194e1c4-4749-4526-a588-07bf21e8ea5b tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 204 len: 0 microversion: 2.1 time: 0.202351 Nov 19 15:07:00.380168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 314/554] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:00 2021] DELETE /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:00.385577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:00.387294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.396282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.396728 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.397605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.398089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.446008 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5161d11-c9bc-4cb2-b257-d70266b00a27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action" status: 202 len: 0 microversion: 2.20 time: 0.168125 Nov 19 15:07:00.447072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 241/555] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:07:00 2021] POST /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:00.452672 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:00.453786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.461861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.462637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.463939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.464632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.493696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f421a2c5-4fc5-4608-97b5-0bafa0f2c79c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 31771 microversion: 2.1 time: 0.110437 Nov 19 15:07:00.495707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 315/556] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:00 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 31771 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:07:00.506389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:00.509966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.573146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.576095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.577959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.582117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.636207 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:00.644128 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-58b0ef6a-53a0-4249-9b94-d1822ed38637 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1513 microversion: 2.1 time: 0.195557 Nov 19 15:07:00.648474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 242/557] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:00 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:00.781313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:00.789942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:00.792512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:00.794900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-40f9ad05-d90a-48a0-9ef3-240bf70cbe99 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1748 microversion: 2.20 time: 0.296650 Nov 19 15:07:00.796833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 316/558] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:00 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1748 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:00.902276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:00.902892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:00.913339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.913806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:00.914607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:00.915050 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.034410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-fee885e0-d2c5-4eb8-834f-cb4d8ecf8050 req-18d216b9-f369-4afa-b6fb-79ecd9b0ac54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a63773-fdbd-42f4-902a-e7a239352c74", "name": "network-vif-plugged", "status": "completed", "tag": "7ecc0bd1-97ba-44d6-9936-ad1121a6f143"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:01.036302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:01.036302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:01.048195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-fee885e0-d2c5-4eb8-834f-cb4d8ecf8050 req-18d216b9-f369-4afa-b6fb-79ecd9b0ac54 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.052665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-fee885e0-d2c5-4eb8-834f-cb4d8ecf8050 req-18d216b9-f369-4afa-b6fb-79ecd9b0ac54 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.070358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-fee885e0-d2c5-4eb8-834f-cb4d8ecf8050 req-18d216b9-f369-4afa-b6fb-79ecd9b0ac54 service nova] Creating event network-vif-plugged:7ecc0bd1-97ba-44d6-9936-ad1121a6f143 for instance 57a63773-fdbd-42f4-902a-e7a239352c74 on hv-cinder-81757 Nov 19 15:07:01.077562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-fee885e0-d2c5-4eb8-834f-cb4d8ecf8050 req-18d216b9-f369-4afa-b6fb-79ecd9b0ac54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046710 Nov 19 15:07:01.079040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 317/559] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:01.141265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:01.153208 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6bafd1d6-485f-4f19-b14d-4912e8a1a343 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1556 microversion: 2.1 time: 0.251056 Nov 19 15:07:01.154197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 243/560] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:00 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1556 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:01.292675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:01.293500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:01.308444 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.309375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.313364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.314026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.507132 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:01.508750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:01.516632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.517367 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.518331 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.519309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.525811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:01.544304 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b401dbfd-0c54-4f9c-bdf6-425fba426e51 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.255237 Nov 19 15:07:01.547796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 318/561] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:01 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:01.663667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:01.664361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:01.678391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.678954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.679989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.680552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.859204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-832e6166-e67a-4642-be38-5e0927ab912a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 32579 microversion: 2.1 time: 0.356169 Nov 19 15:07:01.864407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 244/562] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:01 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 32579 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:07:01.871643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:01.876046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:01.883856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.884732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.885956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:01.886892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:01.904595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:01.924210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-94a6c976-74c4-435a-a6e5-9c4799ab3b56 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1513 microversion: 2.1 time: 0.261709 Nov 19 15:07:01.925581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 319/563] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:01 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:02.095737 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:02.107659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:02.109691 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:02.110908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9231de66-d722-46b1-9c4e-407f2e4cce16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1748 microversion: 2.20 time: 0.244808 Nov 19 15:07:02.112838 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 245/564] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:01 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1748 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:02.175667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:02.177069 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:02.183338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.183871 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.184845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.185417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.389364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:02.397257 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5b44e978-5d1b-423c-89ec-b9b734ce8098 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1556 microversion: 2.1 time: 0.225218 Nov 19 15:07:02.398418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 320/565] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:02 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:02.564768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:02.566321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:02.573866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.574737 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.577085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.577690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.809284 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:02.814056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ea056c17-f569-46f1-a6e6-44a884baf3e6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1317 microversion: 2.1 time: 0.254060 Nov 19 15:07:02.814758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 246/566] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:02 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:02.873508 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:02.881955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:02.895716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.896180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.897091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.897453 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.944482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:02.945366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:02.956141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.957020 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:02.957837 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:02.958270 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.000434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ff432249-1340-472a-9fdb-4ed6392f1ced tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 32975 microversion: 2.1 time: 0.132369 Nov 19 15:07:03.001454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 321/567] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:02 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 32975 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:07:03.006680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'create', calling method: .version_select at 0x7f37c7637700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-474767275"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:03.023026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:07:03.027816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for user ec8a0dc7d9004996b83774f2b4d897a0 and project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:07:03.196561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:03.210802 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7f1c8897-005c-4aea-ba01-5e7f2027978a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 200 len: 1513 microversion: 2.1 time: 0.271604 Nov 19 15:07:03.211705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 247/568] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:02 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:03.224354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:03.224999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:03.240233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.240690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.241515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.241950 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.488518 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:03.495577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:07:03.497861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:03.499479 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:03.500669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b7cd4b1e-2b96-427a-8487-2ac25f86138e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1750 microversion: 2.20 time: 0.287864 Nov 19 15:07:03.500817 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for user ec8a0dc7d9004996b83774f2b4d897a0 and project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:07:03.501255 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 248/569] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:03 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1750 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:03.514044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d7decd6a-b388-47ee-84d4-61a09f3f8f5c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.511246 Nov 19 15:07:03.514802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 322/570] 10.222.0.20 () {60 vars in 1157 bytes} [Fri Nov 19 15:07:03 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:03.516423 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-eb29f271-49fa-4c7b-b306-89e4fa9c4edb req-e8ec9847-1250-4958-925b-5000af465423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2844a016-6b31-4f81-9afe-1b39957cbfe0", "name": "network-vif-deleted", "tag": "0ac64702-51d3-49d3-8e87-d79ee4eb3855"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:03.518042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:03.518042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:03.522380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:03.523113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:03.526141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-eb29f271-49fa-4c7b-b306-89e4fa9c4edb req-e8ec9847-1250-4958-925b-5000af465423 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.527613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-eb29f271-49fa-4c7b-b306-89e4fa9c4edb req-e8ec9847-1250-4958-925b-5000af465423 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.531568 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.532183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.533173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.533726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.540009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-eb29f271-49fa-4c7b-b306-89e4fa9c4edb req-e8ec9847-1250-4958-925b-5000af465423 service nova] Creating event network-vif-deleted:0ac64702-51d3-49d3-8e87-d79ee4eb3855 for instance 2844a016-6b31-4f81-9afe-1b39957cbfe0 on hv-cinder-81757 Nov 19 15:07:03.546027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-eb29f271-49fa-4c7b-b306-89e4fa9c4edb req-e8ec9847-1250-4958-925b-5000af465423 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042718 Nov 19 15:07:03.546765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 249/571] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:03.612606 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-121971487", "imageRef": "5f7df3b0-ebf4-4ef0-9230-574d6fcba8d6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-474767275", "networks": [{"uuid": "383652f0-210b-476d-8368-443456095682"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:03.662031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] validate_networks() for [('383652f0-210b-476d-8368-443456095682', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:07:03.669555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:03.681536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f42d7d76-9adb-427b-b14e-bb75b27fe99f tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1562 microversion: 2.1 time: 0.163613 Nov 19 15:07:03.682218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 323/572] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:03 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:03.757055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:03.757700 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:03.764361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.764984 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.765892 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.766490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.849889 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'services' on Instance uuid d257632a-adba-4ac6-8dd4-1be8485c24a7 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:07:03.942900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0a788adb-4107-4c0c-a91e-77d5d96ef4fd tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments/ea147ac8-d149-4aab-ab48-0b8d5c3aabf4" status: 202 len: 0 microversion: 2.1 time: 0.194559 Nov 19 15:07:03.943726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 324/573] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:07:03 2021] DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments/ea147ac8-d149-4aab-ab48-0b8d5c3aabf4 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:07:03.948516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:03.949245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:03.957102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.957102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:03.958055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:03.958287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.102819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:04.111405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e25a1674-db54-455d-a124-5a387ba39d71 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1507 microversion: 2.1 time: 0.166499 Nov 19 15:07:04.112381 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 325/574] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:03 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:04.129164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:04.130315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:04.136567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.140226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.141008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.141464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.180114 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d057e54b-2ad1-48b7-8af0-dbe33def599a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054890 Nov 19 15:07:04.181337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 326/575] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:04 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:04.186894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:04.188008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:04.194251 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.194705 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.195614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.196051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.291863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:07:04.292285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:07:04.292749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:07:04.293543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:07:04.294086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:07:04.299442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-515c9299-7d5d-4224-ba3d-fd4b05ccc43e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 33641 microversion: 2.1 time: 0.115872 Nov 19 15:07:04.300895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 327/576] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:04 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 33641 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:07:04.304050 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.304687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.305685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.306290 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.308990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:04.310710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 2844a016-6b31-4f81-9afe-1b39957cbfe0] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:04.320483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.322241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.323672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.324552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.326938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:07:04.331955 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Getting quotas for user ec8a0dc7d9004996b83774f2b4d897a0 and project 5188c6afe0f34319b4b787b96f720f3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:07:04.343476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] HTTP exception thrown: Instance 2844a016-6b31-4f81-9afe-1b39957cbfe0 could not be found. Nov 19 15:07:04.344217 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Returning 404 to user: Instance 2844a016-6b31-4f81-9afe-1b39957cbfe0 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:04.345240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:07:04.345384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dd424541-d4ce-4eb5-8298-e8e6ea9cdbbc tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0" status: 404 len: 111 microversion: 2.1 time: 0.042937 Nov 19 15:07:04.345948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 328/577] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:04 2021] GET /compute/v2.1/servers/2844a016-6b31-4f81-9afe-1b39957cbfe0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:07:04.347684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5f7df3b0-ebf4-4ef0-9230-574d6fcba8d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:07:04.418880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19946707-d225-40b4-8364-369f5eddea2e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810080 Nov 19 15:07:04.425266 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 250/578] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:07:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 15:07:04.439490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-58dc7dee-53a9-4036-833d-7ed66c1d2d2a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:04.440515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-58dc7dee-53a9-4036-833d-7ed66c1d2d2a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:04.521222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:04.521913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:04.523059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-58dc7dee-53a9-4036-833d-7ed66c1d2d2a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:04.534617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-58dc7dee-53a9-4036-833d-7ed66c1d2d2a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1257 microversion: 2.1 time: 0.098285 Nov 19 15:07:04.535919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 329/579] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:04 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1257 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:04.546717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.549901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.552091 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:04.552551 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:04.794990 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:04.805043 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:04.806633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:04.808025 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eadc1516-8227-41d1-8cb5-b87a5a35d971 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.292627 Nov 19 15:07:04.808903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 251/580] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:04 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:05.192826 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:05.193959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:05.199894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.200455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.201514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.202111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.236633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7860cde2-8107-4023-9826-7d1a458cd40c tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047892 Nov 19 15:07:05.237270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 330/581] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:05 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:05.311714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:05.312815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:05.319229 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.319767 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.320622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.321166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.554874 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:05.555651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:05.562080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.562530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.563309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.563750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.623158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:05.630461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-824ac39d-6e0e-43d8-a44d-a14724a7969c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1309 microversion: 2.1 time: 0.079239 Nov 19 15:07:05.631023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 331/582] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:05 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1309 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:05.635538 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a7e0f2c-c515-42bc-b393-92bd6c4b398f"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:05.636566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:05.642588 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.643032 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:05.643801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:05.644235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.157288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0d211dd0-ecef-45cf-a196-7a6fa0219998 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 200 len: 38296 microversion: 2.1 time: 14.848953 Nov 19 15:07:20.157932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 252/583] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:05 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 38296 bytes in 14851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:07:20.162670 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:20.163571 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:20.171301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.171752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.172528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.172990 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.293177 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5360ac2c-cbdb-4b5d-89e2-c1c52be69488 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "POST /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.660924 Nov 19 15:07:20.294157 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 332/584] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:07:05 2021] POST /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 194 bytes in 14663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:20.313674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:20.314923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:20.316240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:20.324201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:20.324642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.325132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.325737 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:20.325920 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.326617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.327215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e923d81d-c046-452b-9b88-b8e65fb76457 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.168024 Nov 19 15:07:20.328467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 253/585] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:20 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:20.334245 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:20.334915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:20.342726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.343449 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.344502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.345129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.362030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-28ec0d0a-8685-4d54-bf90-61ebebf1d91a tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061640 Nov 19 15:07:20.363089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 333/586] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:20 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:07:20.369086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-25867591", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "b4ed2e73-3775-4a43-ae59-50f9a111138a"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:20.418844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:20.428691 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-68303350-0b59-43cf-a4b2-4d99a570423e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1309 microversion: 2.1 time: 0.098817 Nov 19 15:07:20.429330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 254/587] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:20 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:20.434171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:20.434656 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:20.441064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.441513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.442294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:20.442727 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:20.458487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] validate_networks() for [('b4ed2e73-3775-4a43-ae59-50f9a111138a', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:07:20.467938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0db839dd-f91a-43ac-82a5-7b9ced5a3e1e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/ips" status: 200 len: 146 microversion: 2.1 time: 0.037533 Nov 19 15:07:20.472851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 255/588] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:07:20 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:21.044375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:07:21.046153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:07:21.047159 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:07:21.047790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:07:21.048687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:07:21.059860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.060781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.061907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.062564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.079514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Getting quotas for project faec73be0ed44740b1d7128823a86838. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:07:21.084543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Getting quotas for user cd9ca6d0907d46d9a96726414a4ae6da and project faec73be0ed44740b1d7128823a86838. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:07:21.105051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:07:21.110081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:07:21.176302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3551fb56-3565-4f0d-b295-f38af8b3a189 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811633 Nov 19 15:07:21.177779 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 334/589] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:07:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:07:21.187706 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e6ae3bc2-7f7f-432b-925b-1124fd36f524 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:21.189467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e6ae3bc2-7f7f-432b-925b-1124fd36f524 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:21.316733 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e6ae3bc2-7f7f-432b-925b-1124fd36f524 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:21.326771 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e6ae3bc2-7f7f-432b-925b-1124fd36f524 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1217 microversion: 2.1 time: 0.142506 Nov 19 15:07:21.329472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 256/590] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:21 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:21.347197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:21.347820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:21.367611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.368074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.368917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.369364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.450326 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:21.451832 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:21.461235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.463908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.466008 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:21.467398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:21.593400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:21.606231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:21.611022 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:21.613139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-eb3e72bb-7f82-4c78-805f-c5a93186637a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.270767 Nov 19 15:07:21.614093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 335/591] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:21 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:21.875649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:21.885448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc7660ef-66c9-490b-97c5-cdb457689db6 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.441651 Nov 19 15:07:21.887436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 257/592] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:21 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:22.346740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:22.347349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:22.354379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.354827 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.355626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.356060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.417157 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:22.424638 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1627710f-145c-470c-8a48-fee861df9150 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.081614 Nov 19 15:07:22.425236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 336/593] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:22 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:22.632907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:22.633666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:22.640367 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.640834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.641614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.642048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.785664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:22.794217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:22.795927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:22.797141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c94f332-7502-4dbd-992b-5b267a6d092d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.168064 Nov 19 15:07:22.797908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 258/594] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:22 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:22.903946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:22.904896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:22.911274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.911940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.912735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.913211 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.955287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:22.956011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:22.962003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.962457 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.963508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:22.963948 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:22.994919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:23.064390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.072822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-500800e6-95bc-497b-97b0-e5492a351e41 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.172400 Nov 19 15:07:23.073768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 337/595] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:22 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:23.098306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b529e5c-e116-462b-92db-c3b36badd5dc tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 204 len: 0 microversion: 2.1 time: 0.146388 Nov 19 15:07:23.101951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 259/596] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:22 2021] DELETE /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:07:23.107389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:23.108237 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:23.114742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.115193 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.115995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.116436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.255091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.262689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-324e51d1-e46d-434b-a26f-db073a8e0eaa tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.159411 Nov 19 15:07:23.265184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 338/597] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:23 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:23.323223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2910883e-1c8e-49a8-835d-3ed7e7a497a3"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:23.324587 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:23.331458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.331900 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.332685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.333140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.441990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:23.442603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:23.448851 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.449302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.450077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.450512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.511966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.519609 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-44f50f18-d55a-4cac-89fd-39f63374b6a8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.081173 Nov 19 15:07:23.520375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 339/598] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:23 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:23.814834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:23.815369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:23.821169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.821619 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.822395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:23.822834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:23.959521 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.968746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.970417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:23.971611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-73925fb2-c3d0-4a76-9e4f-1abeb8350ef9 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.161164 Nov 19 15:07:23.972202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 340/599] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:23 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:24.091563 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:24.092297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:24.098280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.098734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.099515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.099956 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.240283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:24.247572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-31c36e06-de23-407f-82e5-6febcdf38970 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.160037 Nov 19 15:07:24.248777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 341/600] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:24 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:24.282052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:24.283298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:24.289970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.290420 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.291205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.291673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.428518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:24.436582 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d776841c-1914-471d-bd59-90fb0568baf9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.159478 Nov 19 15:07:24.437167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 342/601] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:24 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:24.537101 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:24.537893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:24.545901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.546689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.547713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.548353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.609197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:24.616712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4740e9db-68be-4f52-a1c3-1c2dd9414e07 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.083197 Nov 19 15:07:24.618001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 343/602] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:24 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:24.990019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:24.990546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:24.996560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.997046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:24.997840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:24.998278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.139618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.148404 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.150341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.151976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-98b846a2-94d1-48a2-831d-c6cc45886fc5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.166033 Nov 19 15:07:25.159055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 344/603] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:24 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:25.266021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:25.266546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:25.272398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.272874 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.273652 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.274087 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.422944 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.430113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-19306f37-f9a7-4114-8c3b-7bb5dc4899a7 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.168565 Nov 19 15:07:25.430675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 345/604] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:25 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:25.453038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:25.453654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:25.459896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.460351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.461229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.461613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.599738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.607970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-41c213cb-ed79-4f31-8bbe-da3f1ee05e12 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.157834 Nov 19 15:07:25.608540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 346/605] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:25 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:25.632409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:25.633054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:25.639844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.640301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.641128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:25.641565 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:25.709226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:25.717520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d7b68042-26de-4884-b512-d96efc8ff232 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.087877 Nov 19 15:07:25.718436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 347/606] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:25 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:26.174025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:26.174807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:26.181812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.182268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.183062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.183556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.317814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.326973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.328495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.329672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-80f62825-478c-4ae5-afdb-bf44e32d16e2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.161501 Nov 19 15:07:26.334088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 348/607] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:26 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:26.446914 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:26.447446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:26.454053 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.454519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.457623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.458075 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.595072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.603000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-458a4ece-e6db-469f-9311-ed040cd74e85 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.159714 Nov 19 15:07:26.609225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 349/608] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:26 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:26.624617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:26.625263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:26.631198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.631648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.632424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.632887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.779771 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.788276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ae3640a0-bb79-4d42-94dd-07225abc7e48 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.167174 Nov 19 15:07:26.791670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 350/609] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:26 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:26.793515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:26.794234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:26.800452 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.800934 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.801711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:26.802137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:26.862921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:26.870038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bf25bcd1-9982-4428-beef-77672bdcab26 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.080137 Nov 19 15:07:26.870589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 351/610] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:26 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:27.348482 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:27.349291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:27.355498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.355962 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.356773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.357978 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.493976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:27.504025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:27.505593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:27.506749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ee74dffe-032f-4dd2-98a8-451dd3a942e7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.162459 Nov 19 15:07:27.507305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 352/611] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:27 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:27.619276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:27.619934 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:27.626542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.626997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.627787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.628226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.774216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:27.782327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ff758de7-38c9-4695-a3cf-4548c6675724 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.166736 Nov 19 15:07:27.782927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 353/612] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:27 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:27.805158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:27.805762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:27.811790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.812240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.813064 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.813500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.946661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:27.955153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-48735b6b-c694-44dd-8d97-de7c7015a619 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.153425 Nov 19 15:07:27.955737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 354/613] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:27 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:27.960496 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:27.961149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:27.968371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.968844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:27.969656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:27.970111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.030417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:28.038074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bf9c4a71-7ebe-4067-87aa-99b2be4e3d2c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.081331 Nov 19 15:07:28.038858 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 355/614] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:27 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:28.140616 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:07:28.141193 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:07:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments (ip 10.222.0.20) !!! Nov 19 15:07:28.525417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:28.526676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:28.533783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.534349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.535216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.535726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.678670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:28.687266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:28.688834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:28.689963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e1ad4bc9-d894-4a3e-bd50-14210d18dcb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.168362 Nov 19 15:07:28.690518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 356/615] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:28 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:28.800670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:28.801256 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:28.807418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.807958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.808857 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.809370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.941693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:28.949568 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-01e62236-c284-4789-936b-0ce336054354 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.153694 Nov 19 15:07:28.950139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 357/616] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:28 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:28.972740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:28.973387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:28.979317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.979764 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:28.980567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:28.981027 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.118194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:29.128842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-37597dea-acc2-48b9-a9bc-6dc3fcd15d7b tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.159373 Nov 19 15:07:29.130483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 358/617] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:28 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:29.135930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:29.136723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:29.143755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.144206 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.145054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.145494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.206708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:29.214334 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bbc51635-2361-4d2a-ada3-95bd0c18dfe8 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.082480 Nov 19 15:07:29.215384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 359/618] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:29 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:29.709081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:29.709878 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:29.716391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.717411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.718246 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.718676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.853618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:29.863189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:29.864697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:29.877416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-710659e1-19c9-4584-a6e0-ff2e074fa195 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.160523 Nov 19 15:07:29.878062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 360/619] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:29 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:29.967846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:29.968369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:29.974238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.974685 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:29.975466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:29.975906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.119895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:30.128593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8fd1f160-c2c5-4c3f-95d6-959ab4249f55 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.164642 Nov 19 15:07:30.139033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 361/620] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:29 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:30.145997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:30.146626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:30.152601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.153068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.153903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.154313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.291659 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:30.301017 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-aa0c7334-2bc5-436e-b1e4-266a65d220ff tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.158362 Nov 19 15:07:30.312375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 362/621] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:30 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:30.316951 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:30.317569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:30.323514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.323967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.324741 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.325206 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.388745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:30.396187 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-85e9e009-54ff-4a72-b45f-e246b98ce07a tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.082791 Nov 19 15:07:30.396768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 363/622] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:30 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:30.895362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:30.896937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:30.904442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.905347 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:30.906236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:30.906773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.043379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.052667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.054283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.055560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a7afca7c-edbe-423d-97e1-46afd5fac55e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.163878 Nov 19 15:07:31.056107 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 364/623] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:30 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:31.145928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:31.146575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:31.152930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.153415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.154436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.155126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.305226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.313753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ce03e16d-c87c-48a0-9e0f-b820c0563db5 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.170644 Nov 19 15:07:31.313753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 365/624] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:31 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:31.334417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:31.335025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:31.341234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.342244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.343011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.343439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.476772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.484626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6892c77a-7ec5-4d27-996a-d9182b69c966 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.169247 Nov 19 15:07:31.485218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 366/625] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:31 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:31.489313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:31.489910 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:31.495605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.496138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.496955 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:31.497392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:31.559355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:31.566765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-116bdd9a-438c-467a-b38a-2be5d4f5ac25 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.080616 Nov 19 15:07:31.567327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 367/626] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:31 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:32.074905 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:32.075610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:32.082413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.082860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.083621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.084049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.218356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.226934 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.228364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.229566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ec613ee8-bc4d-4910-9f57-a328f2140b65 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.158372 Nov 19 15:07:32.230126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 368/627] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:32 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:07:32.329773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:32.330372 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:32.336141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.336583 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.337383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.338085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.468216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.475457 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2b6748fd-92c7-4e47-9366-a40dbb620832 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.149383 Nov 19 15:07:32.476047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 369/628] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:32 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:32.501291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:32.501827 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:32.507774 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.508229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.509146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.509589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.642500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.649773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a1d3c53a-b4c8-4776-98ef-657d33e14ec5 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.152135 Nov 19 15:07:32.650330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 370/629] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:32 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:32.655091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:32.655688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:32.661407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.661854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.662629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:32.663059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:32.721405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:32.728502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-facc2e4d-1291-46ac-ba02-fcac30db521e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1221 microversion: 2.1 time: 0.077250 Nov 19 15:07:32.729093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 371/630] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:32 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:33.205730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4af1ec5d-9c1e-486e-958f-8312ed275479 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.889476 Nov 19 15:07:33.209692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 260/631] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:07:23 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments => generated 194 bytes in 9894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:33.247209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:33.247852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:33.255702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.256151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.256965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.257898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.399596 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.408897 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.410418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.411576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-af3608ce-7ca7-450b-87b0-30017013dcaf tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.168003 Nov 19 15:07:33.412134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 372/632] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:33 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:33.493529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:33.494385 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:33.500868 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.501398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.502254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.502791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.667166 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:33.667783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:33.691576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.692320 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.693501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.693921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.705922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.714590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b2558af-dcd0-40fa-b784-6e6c055d16a0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.225576 Nov 19 15:07:33.715175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 261/633] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:33 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:33.744434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:33.745117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:33.767909 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.768366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.769420 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:33.769864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:33.891225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.900898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9bf8f018-aa9f-4f43-b050-21962535897e tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1277 microversion: 2.1 time: 0.159818 Nov 19 15:07:33.902106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 262/634] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:33 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:33.951147 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:33.958548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a6070e0a-8ac1-47a0-a782-6d5cf6124c2e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.294923 Nov 19 15:07:33.969733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 373/635] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:33 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:34.181051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-77ce0fd2-e4c6-4a13-ab0f-a068a37bd704 req-a9f081e4-8af2-4558-a303-5bec3636e9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:34.182688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:34.182688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:34.190881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-77ce0fd2-e4c6-4a13-ab0f-a068a37bd704 req-a9f081e4-8af2-4558-a303-5bec3636e9d3 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.191366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-77ce0fd2-e4c6-4a13-ab0f-a068a37bd704 req-a9f081e4-8af2-4558-a303-5bec3636e9d3 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.209750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-77ce0fd2-e4c6-4a13-ab0f-a068a37bd704 req-a9f081e4-8af2-4558-a303-5bec3636e9d3 service nova] Creating event network-changed:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:07:34.214703 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-77ce0fd2-e4c6-4a13-ab0f-a068a37bd704 req-a9f081e4-8af2-4558-a303-5bec3636e9d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037326 Nov 19 15:07:34.216037 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 263/636] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:34.430084 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:34.430813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:34.438050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.438852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.439658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.440102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.582524 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:34.591081 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:34.592573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:34.593749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0f84a796-a886-4c81-a8c9-b06b83fe9053 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.167636 Nov 19 15:07:34.594373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 374/637] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:34 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:34.733048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:34.733758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:34.740357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.741100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.742277 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.742884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.918296 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:34.918936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:34.925353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.925755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:34.926542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:34.926976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.073585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.079859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.081971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-04b4da37-fde2-4231-a83b-75a45a225272 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.353627 Nov 19 15:07:35.082554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 264/638] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:34 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:35.089016 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:35.089885 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:35.092574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9ce662ae-54cd-4b61-a271-14a70bdc56b4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.177921 Nov 19 15:07:35.096091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 375/639] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:34 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:35.099140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.099601 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.100430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.100888 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.316132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:35.316630 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:35.322592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.323038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.323816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.324249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.417224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lazy-loading 'services' on Instance uuid 57a63773-fdbd-42f4-902a-e7a239352c74 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:07:35.478303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.485971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8dd95c15-fb3d-490f-8c50-babcc8209e34 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.402171 Nov 19 15:07:35.486545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 265/640] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:35 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:35.491947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-78d66ac0-837b-42cf-862d-6f45f6a01592 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments/1a7e0f2c-c515-42bc-b393-92bd6c4b398f" status: 202 len: 0 microversion: 2.1 time: 0.174133 Nov 19 15:07:35.495626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 376/641] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:07:35 2021] DELETE /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments/1a7e0f2c-c515-42bc-b393-92bd6c4b398f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:07:35.500611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:35.501673 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:35.507705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.508081 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.508910 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.509393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.543288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b0cb3fa6-d81f-408e-9ad1-893a2ba4a234 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Nov 19 15:07:35.543856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 266/642] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:35 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:35.612560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:35.613484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:35.620213 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.620666 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.621473 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:35.622043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:35.761020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.769744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.771236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:35.772384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-70927efd-8958-4a6d-86b9-4c2336adddc4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.164274 Nov 19 15:07:35.773035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 377/643] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:35 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:36.099202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:36.099821 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:36.106119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.106562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.107866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.108716 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.116581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:36.117422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:36.126831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.127658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.128630 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.130516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.270872 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:36.278313 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-edbc828e-2621-4914-b70d-56692352938d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.169065 Nov 19 15:07:36.279635 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 378/644] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:36 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:36.289458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-f8d61797-1bad-4194-844f-46b9a14e41ec req-3ecb3411-af25-4b42-8b89-76311349d436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25019dc4-beca-4211-ab7d-0121784e29db", "tag": "fb69f7a6-919b-4c48-a8f6-98d1dac444f5"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:36.289458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:36.289458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:36.295376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-f8d61797-1bad-4194-844f-46b9a14e41ec req-3ecb3411-af25-4b42-8b89-76311349d436 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.295827 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-f8d61797-1bad-4194-844f-46b9a14e41ec req-3ecb3411-af25-4b42-8b89-76311349d436 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.307027 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-f8d61797-1bad-4194-844f-46b9a14e41ec req-3ecb3411-af25-4b42-8b89-76311349d436 service nova] Creating event network-changed:fb69f7a6-919b-4c48-a8f6-98d1dac444f5 for instance 25019dc4-beca-4211-ab7d-0121784e29db on hv-cinder-81757 Nov 19 15:07:36.312322 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-f8d61797-1bad-4194-844f-46b9a14e41ec req-3ecb3411-af25-4b42-8b89-76311349d436 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031578 Nov 19 15:07:36.313121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 379/645] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:36.457556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:36.464963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3cc87b26-3968-4947-bb68-fc8b22eef99c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.369305 Nov 19 15:07:36.465545 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 267/646] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:36 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:36.503464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:36.504909 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:36.511374 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.511822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.512605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.513555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.555288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:36.556224 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:36.562990 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.563553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.564358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.564813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.595830 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-210117bb-9134-4e87-ad02-1a4ffdb7c8c4 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Nov 19 15:07:36.596341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 268/647] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:36 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:36.647001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:36.655480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4def2781-39e3-4b54-b019-ae8de6bc80ec tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1507 microversion: 2.1 time: 0.156018 Nov 19 15:07:36.656054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 380/648] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:36 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:36.791424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:36.791992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:36.799868 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.800350 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:36.801203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:36.801669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.124150 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.134824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.137660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.140135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8aeb2841-1213-4901-8c7c-49b22d6ab1ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.352520 Nov 19 15:07:37.153038 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 269/649] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:36 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:37.297379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:37.297992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:37.305461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.306095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.307272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.307704 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.446124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.453821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3230b267-c761-4be2-a0cc-3d189575166c tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.160499 Nov 19 15:07:37.454581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 381/650] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:37 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:37.482841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:37.483573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:37.489839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.490416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.491304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.491963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.606541 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:37.607653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:37.613886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.614332 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.615113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.615544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.647056 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c42856e1-50b7-4036-aa1e-b276862727b8 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Nov 19 15:07:37.647972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 382/651] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:37 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:37.674092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:37.674707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:37.680537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.681458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.681802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.682233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.713712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:37.714156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:37.714607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'fault' on Instance uuid 1ffd2431-3834-482a-b5b7-872064a1058a {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:07:37.742529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.752222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b43e6138-d5c2-4b6c-8ddb-38d6c28a340f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.273543 Nov 19 15:07:37.764163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 270/652] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:37 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:37.769705 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:37.777276 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4010be72-7a01-4b2e-8a5f-33e28c75cd01 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 200 len: 1311 microversion: 2.1 time: 0.107902 Nov 19 15:07:37.778457 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 383/653] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:37 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:38.158228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.158853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.165163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.165610 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.166387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.166824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.297014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:38.305283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:38.306784 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:38.307938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de30c8cc-1628-45ed-87e9-35cfa1ed21b3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.153512 Nov 19 15:07:38.308503 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 271/654] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:38.345191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-22958cac-4e80-48f7-8c4b-65460e460ca4 req-d946b9d1-24c2-41a9-b714-50f549047c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffd2431-3834-482a-b5b7-872064a1058a", "name": "network-vif-deleted", "tag": "b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:38.346716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:38.346716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:38.353495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-22958cac-4e80-48f7-8c4b-65460e460ca4 req-d946b9d1-24c2-41a9-b714-50f549047c32 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.353945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-22958cac-4e80-48f7-8c4b-65460e460ca4 req-d946b9d1-24c2-41a9-b714-50f549047c32 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.364743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-22958cac-4e80-48f7-8c4b-65460e460ca4 req-d946b9d1-24c2-41a9-b714-50f549047c32 service nova] Creating event network-vif-deleted:b8fda7da-8eb5-4b5f-880e-2cfa9a3b709c for instance 1ffd2431-3834-482a-b5b7-872064a1058a on hv-cinder-81757 Nov 19 15:07:38.369534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-22958cac-4e80-48f7-8c4b-65460e460ca4 req-d946b9d1-24c2-41a9-b714-50f549047c32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027986 Nov 19 15:07:38.370102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 384/655] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:38.471009 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.471678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.477572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.478027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.478799 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.479235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.611596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:38.618994 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de4f4928-e0a7-46f2-a6f5-acbc1210a362 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.151597 Nov 19 15:07:38.619489 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 272/656] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:38.659236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.660269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.666442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.666893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.667680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.668121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.698004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-23a2fed5-fca9-4702-94a6-900b18b61d0d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Nov 19 15:07:38.698562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 385/657] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:38.769650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.770258 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.776126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.776570 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.777373 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.777807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.795491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.796323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: 1ffd2431-3834-482a-b5b7-872064a1058a] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.802140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.802591 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.803377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.803813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.817046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] HTTP exception thrown: Instance 1ffd2431-3834-482a-b5b7-872064a1058a could not be found. Nov 19 15:07:38.817647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Returning 404 to user: Instance 1ffd2431-3834-482a-b5b7-872064a1058a could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:38.818471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f1cd202b-1ceb-4383-991b-1cea77d9a411 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a" status: 404 len: 111 microversion: 2.1 time: 0.027363 Nov 19 15:07:38.819019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 386/658] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/1ffd2431-3834-482a-b5b7-872064a1058a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:07:38.826554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.827045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.832876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.833320 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.834097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.834534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.862469 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:38.913555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:38.925682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81996aef-31ae-4bcf-9278-49843b1c0246 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.158854 Nov 19 15:07:38.926380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 273/659] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:38.947570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0c5cd279-7785-4e9f-b2d1-0aa8d6725ea6 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 204 len: 0 microversion: 2.1 time: 0.124142 Nov 19 15:07:38.948432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 387/660] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:38 2021] DELETE /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:07:38.956335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:38.956970 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:38.962941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.963397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:38.964168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:38.964599 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.098372 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:39.106005 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65fbe0e0-c3a1-4ce2-a9fc-070183a90fe3 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.153286 Nov 19 15:07:39.106780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 274/661] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:38 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:39.180730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-46e71290-d80e-420e-82c7-584fd845ae57 req-5f112137-b262-41f8-9c9a-38c308dbeed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "name": "network-vif-plugged", "status": "completed", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:39.182243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:39.182243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:39.189683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-46e71290-d80e-420e-82c7-584fd845ae57 req-5f112137-b262-41f8-9c9a-38c308dbeed8 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.189924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-46e71290-d80e-420e-82c7-584fd845ae57 req-5f112137-b262-41f8-9c9a-38c308dbeed8 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.201571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-46e71290-d80e-420e-82c7-584fd845ae57 req-5f112137-b262-41f8-9c9a-38c308dbeed8 service nova] Creating event network-vif-plugged:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:07:39.206479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-46e71290-d80e-420e-82c7-584fd845ae57 req-5f112137-b262-41f8-9c9a-38c308dbeed8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029696 Nov 19 15:07:39.207342 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 388/662] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:39.327267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:39.327872 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:39.334190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.334636 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.335408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.335845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.464458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:39.473380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:39.474858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:39.476001 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06780944-8485-4f3b-869a-9fe8f9399eef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.152972 Nov 19 15:07:39.476553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 275/663] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:39 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:39.636434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:39.637145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:39.645004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.646286 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.647256 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.647699 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.709834 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:39.710921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:39.717939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.718622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.719419 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.719989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.759040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ebbde6ba-6bd1-4804-a8b5-b4d26011ae61 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053323 Nov 19 15:07:39.760190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 276/664] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:39 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:39.791418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:39.800180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d9b40cd4-4075-4a04-9d87-78d56b4662c9 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.168240 Nov 19 15:07:39.800731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 389/665] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:39 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:39.942831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:39.943435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:39.949319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.949768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:39.951107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:39.951574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.080434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.087504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f982d42a-b1eb-4854-830d-d9ccfca5181a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.148294 Nov 19 15:07:40.088321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 277/666] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:39 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:40.123171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:40.123778 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:40.129607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.130058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.130832 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.131269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.257877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.265647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6a99f955-f219-4939-804c-7eda5265a5fb tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.146227 Nov 19 15:07:40.266203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 390/667] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:40 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:40.494254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:40.495106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:40.502333 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.502779 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.503547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.503978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.637474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.646168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.647649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.648819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7414efc7-f8ef-44c1-9fcd-49adf6fecc3f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.158398 Nov 19 15:07:40.649371 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 278/668] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:40 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:40.771003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:40.771918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:40.778144 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.778646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.779516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.779958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.808817 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1d1fa76b-aa77-47a0-ba06-928cb1e98ea1 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041540 Nov 19 15:07:40.809436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 391/669] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:40 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:40.816965 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:40.817572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:40.823366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.823810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.824573 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:40.825040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:40.957755 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:40.965228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8978ef51-6f6f-4d90-a086-8989855936f1 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.151791 Nov 19 15:07:40.965795 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 279/670] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:40 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:41.104970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.105589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.111894 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.112348 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.113390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.113822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.229865 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-81772153-16ea-43b3-b69a-4576d64a58bb req-935bb0d7-4c78-4862-a9c4-b98f45956fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "name": "network-vif-plugged", "status": "completed", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:41.232374 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:41.232374 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:41.243126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-81772153-16ea-43b3-b69a-4576d64a58bb req-935bb0d7-4c78-4862-a9c4-b98f45956fa8 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.243911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-81772153-16ea-43b3-b69a-4576d64a58bb req-935bb0d7-4c78-4862-a9c4-b98f45956fa8 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.257112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-81772153-16ea-43b3-b69a-4576d64a58bb req-935bb0d7-4c78-4862-a9c4-b98f45956fa8 service nova] Creating event network-vif-plugged:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:07:41.270205 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-81772153-16ea-43b3-b69a-4576d64a58bb req-935bb0d7-4c78-4862-a9c4-b98f45956fa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045083 Nov 19 15:07:41.271014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 280/671] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:41.277279 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:41.291442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0e46e973-75e9-4cdc-a4e4-4d9b9ee8fa29 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.185835 Nov 19 15:07:41.292301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 392/672] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:41.296494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.297476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.304159 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.304826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.306483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.306483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.455564 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:41.463749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f3f56677-f2d6-441e-b47e-2f2d8224786d tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.172745 Nov 19 15:07:41.464637 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 281/673] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:41.666703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.667310 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.673715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.674168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.674951 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.675427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.783862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5ae5c95-3693-4736-8da1-d06d58a554b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:41.791099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5ae5c95-3693-4736-8da1-d06d58a554b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.791555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5ae5c95-3693-4736-8da1-d06d58a554b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.860130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:41.864087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5ae5c95-3693-4736-8da1-d06d58a554b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Going to try to stop instance {{(pid=116266) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 15:07:41.869263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:41.875470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:41.876906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5d873aa8-2586-4a05-a067-3521ee50f77b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1806 microversion: 2.20 time: 0.213669 Nov 19 15:07:41.877470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 393/674] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:41.887188 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.889249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.896759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.897236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.898078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.898513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.910937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5ae5c95-3693-4736-8da1-d06d58a554b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 202 len: 0 microversion: 2.1 time: 0.130757 Nov 19 15:07:41.917518 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 282/675] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:41 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:07:41.930042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.930795 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.938018 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.938466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.939275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.939707 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.944709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ee31289e-79c0-4f54-a56c-2820acc2f091 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065929 Nov 19 15:07:41.945422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 394/676] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:41.985421 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:41.986395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:41.993006 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.993540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:41.994433 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:41.994937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.078006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:42.085803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-952f4a62-ac47-4f46-b206-c7a2433e2041 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.159957 Nov 19 15:07:42.086362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 283/677] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:42.153124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:42.162981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-25ec6f92-a451-4494-8c92-19229a53b22d tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.184467 Nov 19 15:07:42.163542 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 395/678] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:41 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:42.308604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:42.309251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:42.315212 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.315664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.316441 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.316920 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.444033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:42.451633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5929f5f-153f-4a7a-8332-0d13866b7aac tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1357 microversion: 2.1 time: 0.146684 Nov 19 15:07:42.452182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 284/679] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:42 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:42.480176 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:42.480782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:42.487220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.487688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.488455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.488907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.616745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:42.623881 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cf3fe29d-d32a-455c-b758-60511cf9df68 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.147304 Nov 19 15:07:42.624430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 396/680] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:42 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:42.894865 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:42.895457 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:42.901690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.902140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.902918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.903358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.956422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:42.957491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:42.964728 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.965203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.966077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:42.967029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:42.996592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8370c21c-c570-4fba-8a0a-0df652fde0f9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044187 Nov 19 15:07:42.998969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 397/681] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:07:42 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:07:43.068657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.080615 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.082313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.083540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1976fa5f-2b51-4c23-a220-27ea6c849e1b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1793 microversion: 2.20 time: 0.192441 Nov 19 15:07:43.097733 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 285/682] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:07:42 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1793 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:07:43.104727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.105529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:43.114711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.115539 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.116501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.117128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.183674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.184288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:43.198369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.198828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.199626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.200067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.271697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.280550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c8dba01d-50f8-44b3-a1fa-5ab0f8663b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.180742 Nov 19 15:07:43.281153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 398/683] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:43.295388 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-e3b3763e-ccae-46cc-9353-0a38c6908422 req-2ccaa7f4-4d2a-4827-ba48-7a5e25cceaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25019dc4-beca-4211-ab7d-0121784e29db", "name": "network-vif-plugged", "status": "completed", "tag": "fb69f7a6-919b-4c48-a8f6-98d1dac444f5"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:43.296982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:43.296982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:43.303683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e3b3763e-ccae-46cc-9353-0a38c6908422 req-2ccaa7f4-4d2a-4827-ba48-7a5e25cceaea service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.304120 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e3b3763e-ccae-46cc-9353-0a38c6908422 req-2ccaa7f4-4d2a-4827-ba48-7a5e25cceaea service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.315639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-e3b3763e-ccae-46cc-9353-0a38c6908422 req-2ccaa7f4-4d2a-4827-ba48-7a5e25cceaea service nova] Creating event network-vif-plugged:fb69f7a6-919b-4c48-a8f6-98d1dac444f5 for instance 25019dc4-beca-4211-ab7d-0121784e29db on hv-cinder-81757 Nov 19 15:07:43.320534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-e3b3763e-ccae-46cc-9353-0a38c6908422 req-2ccaa7f4-4d2a-4827-ba48-7a5e25cceaea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028840 Nov 19 15:07:43.321181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 399/684] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:43.339659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.347200 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-431e8194-80d5-42c3-8c8e-a795febc7221 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.171522 Nov 19 15:07:43.347857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 286/685] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:43.468770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.469579 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:43.475819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.476272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.477082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.477523 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.611831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.619277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9c2dbed1-4d09-4b54-9772-791583f75e97 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1546 microversion: 2.1 time: 0.155262 Nov 19 15:07:43.619830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 400/686] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:43.635519 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.636156 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:43.640730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.641361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:43.642546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.643165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.643943 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.644382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.647035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.647514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.648296 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.648730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.776198 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.778207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.784079 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56b71f6c-fd43-4c0f-911e-55d9bab9de09 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1546 microversion: 2.1 time: 0.152184 Nov 19 15:07:43.784657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 287/687] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:43.785645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7ea0d1ce-0521-40f4-8de6-aa866c7cb8c9 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.149156 Nov 19 15:07:43.786278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 401/688] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:43.800355 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:43.803671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:43.803671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:43.804638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:43.805405 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Searching by: {'deleted': False, 'project_id': '5188c6afe0f34319b4b787b96f720f3b'} {{(pid=116266) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 19 15:07:43.812864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.813261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.814061 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:43.814519 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:43.902630 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.multi_cell_list [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116266) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 19 15:07:43.996924 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0aac5641-3b5e-433c-a096-3803be13d267 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200102 Nov 19 15:07:43.998071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 288/689] 10.222.0.20 () {58 vars in 1124 bytes} [Fri Nov 19 15:07:43 2021] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:44.008106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.008819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.015573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.016024 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.016820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.017269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.147524 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:44.155515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-48750d99-4f58-43a1-b62e-4e3b5712ea4c tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1546 microversion: 2.1 time: 0.151026 Nov 19 15:07:44.156082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 402/690] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:44 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:44.220032 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.220512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.226553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.227093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.227873 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.228304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.252951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:44.298533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.299448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.306264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.307025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.307974 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.308696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.329860 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-39d2bb1f-98a2-4f85-9288-06168e787a53 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 204 len: 0 microversion: 2.1 time: 0.112962 Nov 19 15:07:44.330574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 289/691] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:44 2021] DELETE /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:44.339263 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.339969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.346562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.347066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.347798 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.348240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.481326 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:44.489292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-32643075-0a35-4a58-9eb9-6a157bfe42b6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.195175 Nov 19 15:07:44.490641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 403/692] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:44 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:44.494711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.495383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.501597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.502043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.502886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.503353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.518181 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:44.525575 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-159ab74f-0f8c-4e5a-8f4f-854f83da4cd9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1513 microversion: 2.1 time: 0.190653 Nov 19 15:07:44.526149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 290/693] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:44 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:44.637619 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:44.644695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-323fe756-bd4a-4475-a3bc-6f4e7eef4625 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.153361 Nov 19 15:07:44.645285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 404/694] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:44 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:44.802743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:44.803381 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:44.809430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.809927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.811010 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:44.811451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:44.942236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:44.949476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-809d41db-dba1-4f1b-8505-9ac5ecbaa89e tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.150363 Nov 19 15:07:44.950031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 291/695] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:44 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:45.506401 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:45.507011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:45.513153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.513601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.514376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.514810 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.542542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:45.543238 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:45.549911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.550444 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.551324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.551833 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.660807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:45.668559 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-42d363ff-cfeb-4aa1-ad75-4cc7c907d7a5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.165633 Nov 19 15:07:45.669787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 405/696] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:45 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:45.678611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:45.679409 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:45.686040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.687026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.687904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.688440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.703437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:45.710731 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b176b028-623c-4be8-95b8-ab4218d468bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1513 microversion: 2.1 time: 0.171806 Nov 19 15:07:45.711299 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 292/697] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:45 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:45.717125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce629b8f-6a38-4efe-8fa9-7daa93f38d04"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:45.718339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:45.724446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.724928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.725712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.726148 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.821932 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:45.830324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a78a2270-0273-4792-bda0-b7a50e127082 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1317 microversion: 2.1 time: 0.155208 Nov 19 15:07:45.830885 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 406/698] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:45 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:45.968738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:45.969361 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2c7677b6-9533-4652-a2d5-9933553bf747 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256661 Nov 19 15:07:45.969478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:45.970149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 293/699] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:07:45 2021] POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:45.980629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.981309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:45.982072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:45.982514 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.121515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:46.130837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f405f7f4-0453-491e-936f-97c98eb636df tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.167946 Nov 19 15:07:46.132026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 407/700] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:45 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:46.687724 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:46.688414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:46.694463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.694905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.695675 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.696106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.727122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:46.727726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:46.734947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.735397 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.736183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.736621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.831202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:46.839872 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3239f990-78b3-4b94-b646-3b0d32cfec36 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.157112 Nov 19 15:07:46.840695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 294/701] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:46 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:46.854013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:46.855168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:46.861969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.862415 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.863192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:46.863620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:46.870330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:46.877730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ce608a6e-e139-471c-ac20-eefd34071988 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1513 microversion: 2.1 time: 0.154010 Nov 19 15:07:46.878298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 408/702] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:46 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:46.992513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:47.001006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e50fd00-39a1-4854-bde9-3da828b984d4 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1506 microversion: 2.1 time: 0.150748 Nov 19 15:07:47.001601 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 295/703] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:46 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:47.017569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13fa07ad-fae2-4dc8-911a-73c4cb2d28f0", "device": "/dev/sdb"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:47.019192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:47.025049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.025508 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.026307 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.026752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.148566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:47.149283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:47.155815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.156345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.157237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.157760 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.282483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f2f4716f-cdd5-4e8b-91e9-628f5164529f tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "POST /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268521 Nov 19 15:07:47.283319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 409/704] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:07:47 2021] POST /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:47.414998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:47.422983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cf3a52b2-e2d8-4a37-9a1c-655cc4588c66 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1522 microversion: 2.1 time: 0.278730 Nov 19 15:07:47.423638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 296/705] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:47 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:47.817331 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-17120b39-275b-472d-b51d-5f5a8f6759e5 req-a0a72b1d-18c4-4645-9512-4f8f9aae3e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a63773-fdbd-42f4-902a-e7a239352c74", "name": "network-vif-deleted", "tag": "7ecc0bd1-97ba-44d6-9936-ad1121a6f143"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:47.821564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:47.821564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:47.832710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-17120b39-275b-472d-b51d-5f5a8f6759e5 req-a0a72b1d-18c4-4645-9512-4f8f9aae3e70 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.833557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-17120b39-275b-472d-b51d-5f5a8f6759e5 req-a0a72b1d-18c4-4645-9512-4f8f9aae3e70 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.850045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-17120b39-275b-472d-b51d-5f5a8f6759e5 req-a0a72b1d-18c4-4645-9512-4f8f9aae3e70 service nova] Creating event network-vif-deleted:7ecc0bd1-97ba-44d6-9936-ad1121a6f143 for instance 57a63773-fdbd-42f4-902a-e7a239352c74 on hv-cinder-81757 Nov 19 15:07:47.857929 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:47.859548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:47.871807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.874002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-17120b39-275b-472d-b51d-5f5a8f6759e5 req-a0a72b1d-18c4-4645-9512-4f8f9aae3e70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063099 Nov 19 15:07:47.874664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.875636 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.877577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 410/706] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:47.877896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.895074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:47.896022 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:47.909403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.909864 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.910671 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.911111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.965437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:47.966451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:47.967059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lazy-loading 'fault' on Instance uuid 57a63773-fdbd-42f4-902a-e7a239352c74 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:07:48.009766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:48.021459 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c3a6cb93-38f7-4339-bff3-e2b91c215260 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 200 len: 1307 microversion: 2.1 time: 0.130799 Nov 19 15:07:48.022632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 411/707] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:47 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:48.127906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:48.136244 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fde8d303-d2ed-4fcb-8703-4f93ce252b51 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.283870 Nov 19 15:07:48.136974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 297/708] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:47 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:48.440070 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:48.440677 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:48.446972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:48.447422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:48.448200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:48.448635 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:48.479441 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:48.479802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:48.480250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lazy-loading 'fault' on Instance uuid d257632a-adba-4ac6-8dd4-1be8485c24a7 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:07:48.524024 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91bfc8da9065458d986a23b7c96ba0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb244c677264a58ae8a06742292aba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:48.532043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1f6ef844-95e7-4ab9-a95b-ba17825a55b0 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 200 len: 1312 microversion: 2.1 time: 0.095610 Nov 19 15:07:48.532604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 412/709] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:48 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:49.039278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:49.039801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 57a63773-fdbd-42f4-902a-e7a239352c74] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:49.046753 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.047201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.047977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.048410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.061536 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Instance 57a63773-fdbd-42f4-902a-e7a239352c74 could not be found. Nov 19 15:07:49.062135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 404 to user: Instance 57a63773-fdbd-42f4-902a-e7a239352c74 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:49.062928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3bf50ce0-735f-4f22-a707-3e12d6aa6057 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74" status: 404 len: 111 microversion: 2.1 time: 0.027456 Nov 19 15:07:49.063435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 298/710] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:49 2021] GET /compute/v2.1/servers/57a63773-fdbd-42f4-902a-e7a239352c74 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:07:49.163607 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:49.165069 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:49.171772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.172220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.173052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.173490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.302571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:49.311319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-64a96c91-be8a-498c-a191-e72d1cbd1eb3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.159457 Nov 19 15:07:49.311943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 413/711] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:49 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:49.549456 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:49.550195 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] [instance: d257632a-adba-4ac6-8dd4-1be8485c24a7] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:49.556301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.556760 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.557717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.558192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.570977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] HTTP exception thrown: Instance d257632a-adba-4ac6-8dd4-1be8485c24a7 could not be found. Nov 19 15:07:49.571562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] Returning 404 to user: Instance d257632a-adba-4ac6-8dd4-1be8485c24a7 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:49.572375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6c9957a7-b05a-4234-9bdb-a33f9244fdd8 tempest-ServerRescueNegativeTestJSON-1657824624 tempest-ServerRescueNegativeTestJSON-1657824624-project] 10.222.0.20 "GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7" status: 404 len: 111 microversion: 2.1 time: 0.026679 Nov 19 15:07:49.572989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 299/712] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:49 2021] GET /compute/v2.1/servers/d257632a-adba-4ac6-8dd4-1be8485c24a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:07:49.955862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-8cac0abd-0eb6-4c06-8320-79c413d9b37e req-229a7907-3e22-4435-8ca3-627e5f5c5b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d257632a-adba-4ac6-8dd4-1be8485c24a7", "name": "network-vif-deleted", "tag": "24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:49.957440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:49.957440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:07:49.964688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-8cac0abd-0eb6-4c06-8320-79c413d9b37e req-229a7907-3e22-4435-8ca3-627e5f5c5b0a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:49.965164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-8cac0abd-0eb6-4c06-8320-79c413d9b37e req-229a7907-3e22-4435-8ca3-627e5f5c5b0a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:49.976324 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-8cac0abd-0eb6-4c06-8320-79c413d9b37e req-229a7907-3e22-4435-8ca3-627e5f5c5b0a service nova] Creating event network-vif-deleted:24159a48-e3e8-4c4e-bfd6-209c5ec2e9e4 for instance d257632a-adba-4ac6-8dd4-1be8485c24a7 on hv-cinder-81757 Nov 19 15:07:49.981371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-8cac0abd-0eb6-4c06-8320-79c413d9b37e req-229a7907-3e22-4435-8ca3-627e5f5c5b0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029200 Nov 19 15:07:49.981990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 414/713] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:50.186847 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:50.187370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:50.194396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.194846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.195684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.196062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.227601 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:50.300812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f106f7c-8173-4d35-ab87-d9527088f1c6 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 204 len: 0 microversion: 2.1 time: 0.117950 Nov 19 15:07:50.301680 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 300/714] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:50 2021] DELETE /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:50.311124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:50.311822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:50.318255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.318697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.319492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.319921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.330335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:50.331028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:50.337312 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.338064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.338865 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:50.339298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:50.479138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:50.489970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-255ddbd9-95cc-42dc-883e-85f0681a74c5 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1514 microversion: 2.1 time: 0.183916 Nov 19 15:07:50.500945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 415/715] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:50 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:50.632534 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:50.640863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81f1969d-c7d9-48a3-9666-571469ba27e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.315273 Nov 19 15:07:50.641429 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 301/716] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:50 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:51.510583 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:51.511242 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:51.521381 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:51.521915 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:51.522782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:51.523286 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:51.659129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:51.660343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:51.666885 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:51.667612 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:51.668577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:51.668841 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:51.670272 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:51.677386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d9c50c5d-de88-49b0-a8de-0ab555626446 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1514 microversion: 2.1 time: 0.172363 Nov 19 15:07:51.677958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 416/717] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:51 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:51.898231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:51.907089 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e50f58dc-8303-4d2b-9f0f-53c27e98a753 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.251473 Nov 19 15:07:51.907934 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 302/718] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:51 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:52.697887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:52.699044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:52.715484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:52.716724 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:52.717740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:52.718328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:52.874349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:52.884283 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-caecb573-a6b1-4f1c-a2bd-230879ddc993 req-0f613d71-857a-4fc1-8a7b-2d9359a5df19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e373f462-cbce-4d02-8a0b-b96fb6b005f9", "name": "network-vif-deleted", "tag": "5f995ca5-5a2a-41de-8527-16927df2788a"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:52.890808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:52.890808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:52.906038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a657feee-444a-47ea-8d2d-7e4e0ff15aa0 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 200 len: 1472 microversion: 2.1 time: 0.214779 Nov 19 15:07:52.906624 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 417/719] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:52 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:52.912268 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-caecb573-a6b1-4f1c-a2bd-230879ddc993 req-0f613d71-857a-4fc1-8a7b-2d9359a5df19 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:52.912955 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-caecb573-a6b1-4f1c-a2bd-230879ddc993 req-0f613d71-857a-4fc1-8a7b-2d9359a5df19 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:52.925522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:52.926354 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:52.941162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:52.942691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:52.944580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:52.945436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:52.958230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-caecb573-a6b1-4f1c-a2bd-230879ddc993 req-0f613d71-857a-4fc1-8a7b-2d9359a5df19 service nova] Creating event network-vif-deleted:5f995ca5-5a2a-41de-8527-16927df2788a for instance e373f462-cbce-4d02-8a0b-b96fb6b005f9 on hv-cinder-81757 Nov 19 15:07:52.974117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-caecb573-a6b1-4f1c-a2bd-230879ddc993 req-0f613d71-857a-4fc1-8a7b-2d9359a5df19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107611 Nov 19 15:07:52.976932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 303/720] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:53.121431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:53.131821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a8618d59-a839-4f89-8c6d-8d3d9b4b98ac tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.210709 Nov 19 15:07:53.132829 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 418/721] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:52 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:53.527839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:53.529122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:53.535639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.536181 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.537075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.537576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.679300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:53.687696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-403823bd-2503-4800-869f-2f1950a9260f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1592 microversion: 2.1 time: 0.164314 Nov 19 15:07:53.688348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 304/722] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:53 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1592 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:53.923139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:53.923745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: e373f462-cbce-4d02-8a0b-b96fb6b005f9] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:53.930349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.930975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.931896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.932328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.947449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Instance e373f462-cbce-4d02-8a0b-b96fb6b005f9 could not be found. Nov 19 15:07:53.948046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 404 to user: Instance e373f462-cbce-4d02-8a0b-b96fb6b005f9 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:53.948957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-789aee72-f4c1-4fe9-85b0-508715b71c6a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9" status: 404 len: 111 microversion: 2.1 time: 0.029993 Nov 19 15:07:53.953442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 419/723] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:53 2021] GET /compute/v2.1/servers/e373f462-cbce-4d02-8a0b-b96fb6b005f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:07:53.958544 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:53.959045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:53.965781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.966247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.967142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:53.967758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:53.993674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:54.071443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3db5c859-cfa2-44bb-a532-9b52c1ee2ca9 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 204 len: 0 microversion: 2.1 time: 0.116270 Nov 19 15:07:54.072678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 305/724] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:53 2021] DELETE /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:54.081107 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:54.081725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:54.087916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:54.088407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:54.089510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:54.089967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:54.152426 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:54.153131 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:54.159199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:54.159652 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:54.160444 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:54.161117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:54.311178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:54.313314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:54.319742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c978026d-95a2-454a-9b50-d89eff3314fc tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1513 microversion: 2.1 time: 0.242573 Nov 19 15:07:54.321745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 420/725] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:54 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:54.322297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5617adf0-0188-475f-a4f0-619f23e980fa tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.175912 Nov 19 15:07:54.323097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 306/726] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:54 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:55.338120 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:55.338989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:55.339973 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:55.340747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:55.345869 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:55.346412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:55.347285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:55.347554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:55.347872 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:55.348295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:55.349343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:55.349861 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:55.499026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:55.508038 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-894c1a4b-9302-41eb-a217-92e34fcf30e8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.172577 Nov 19 15:07:55.508714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 307/727] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:55 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:55.626712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:55.635073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6e17c58f-541f-4da9-9b2a-65a67d5899eb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1513 microversion: 2.1 time: 0.301451 Nov 19 15:07:55.635841 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 421/728] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:55 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:55.947316 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-f2d5de9d-bf3a-4a47-bbef-c7ff08db3aca req-878d7c13-5760-4575-8ac6-835397771615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:55.948959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:55.948959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:55.965446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f2d5de9d-bf3a-4a47-bbef-c7ff08db3aca req-878d7c13-5760-4575-8ac6-835397771615 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:55.966313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f2d5de9d-bf3a-4a47-bbef-c7ff08db3aca req-878d7c13-5760-4575-8ac6-835397771615 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:55.984020 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-f2d5de9d-bf3a-4a47-bbef-c7ff08db3aca req-878d7c13-5760-4575-8ac6-835397771615 service nova] Creating event network-changed:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:07:55.997972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-f2d5de9d-bf3a-4a47-bbef-c7ff08db3aca req-878d7c13-5760-4575-8ac6-835397771615 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048756 Nov 19 15:07:55.998767 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 308/729] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:56.533524 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:56.534943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:56.541880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:56.542553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:56.544203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:56.544848 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:56.596038 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-f3d49e78-30cd-4893-91ef-f75a92a65293 req-46619f3e-a277-4c03-abb1-b79e90a698d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf74e04-9035-489f-b215-c529bd5be90d", "name": "network-vif-deleted", "tag": "61ee76dd-0723-435f-bbf8-8a7d6039b176"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:56.598434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:56.598434 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:56.609438 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f3d49e78-30cd-4893-91ef-f75a92a65293 req-46619f3e-a277-4c03-abb1-b79e90a698d1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:56.610354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f3d49e78-30cd-4893-91ef-f75a92a65293 req-46619f3e-a277-4c03-abb1-b79e90a698d1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:56.628237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-f3d49e78-30cd-4893-91ef-f75a92a65293 req-46619f3e-a277-4c03-abb1-b79e90a698d1 service nova] Creating event network-vif-deleted:61ee76dd-0723-435f-bbf8-8a7d6039b176 for instance 3cf74e04-9035-489f-b215-c529bd5be90d on hv-cinder-81757 Nov 19 15:07:56.633431 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-f3d49e78-30cd-4893-91ef-f75a92a65293 req-46619f3e-a277-4c03-abb1-b79e90a698d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042155 Nov 19 15:07:56.634153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 309/730] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:07:56.656357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:56.657474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:56.670681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:56.671363 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:56.672626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:56.673291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:56.792424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:56.792998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:56.805992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dcf2043d-3a14-4fef-ac62-1b9f4ce50fa2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 200 len: 1302 microversion: 2.1 time: 0.151402 Nov 19 15:07:56.807247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 310/731] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:56 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:56.816660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8e67db2e-22a1-4a49-ab0b-579085ba5dff tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.285043 Nov 19 15:07:56.819959 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 422/732] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:56 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:57.563389 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1413447841"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:57.563925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:57.570844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.571580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:57.572611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.573246 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:57.732920 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.network.security_group_api [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Adding security group b42cf0a5-1d18-486b-a0f6-fd5ef81f3cd3 to port d9cbc786-bc49-4094-b804-87076d431575 Nov 19 15:07:57.823335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:57.824495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 3cf74e04-9035-489f-b215-c529bd5be90d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:57.831116 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.831535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:57.832319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.832753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:57.848093 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Instance 3cf74e04-9035-489f-b215-c529bd5be90d could not be found. Nov 19 15:07:57.848731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 404 to user: Instance 3cf74e04-9035-489f-b215-c529bd5be90d could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:07:57.849781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f5c84715-3f49-49eb-b79b-276245d90f03 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d" status: 404 len: 111 microversion: 2.1 time: 0.030222 Nov 19 15:07:57.850325 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 423/733] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:57 2021] GET /compute/v2.1/servers/3cf74e04-9035-489f-b215-c529bd5be90d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:07:57.858540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:57.859197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:57.865784 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.866240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:57.867039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:57.867479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:58.030766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:58.038586 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1e7fcb0a-773d-4fe8-aa8a-079932d5a572 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.187145 Nov 19 15:07:58.039164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 424/734] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:57 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:07:58.143327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12d85460-5ff3-4479-b796-9f1d52404cde tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action" status: 202 len: 0 microversion: 2.1 time: 0.584101 Nov 19 15:07:58.147583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 311/735] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:07:57 2021] POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:07:58.157290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:58.158204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:58.164900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:58.165664 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:58.166646 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:58.167286 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:58.333954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:58.344148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7b48f0b5-cc9c-43ec-a143-1d4fb988ecec tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1757 microversion: 2.1 time: 0.195022 Nov 19 15:07:58.344847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 425/736] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:58 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:58.656883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-8e6c30a8-351d-417f-baa8-a0a1dabc3ca4 req-73c391bb-9df2-4aaf-bf33-ba9d2d39a42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:07:58.658439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:07:58.658439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:07:58.665296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-8e6c30a8-351d-417f-baa8-a0a1dabc3ca4 req-73c391bb-9df2-4aaf-bf33-ba9d2d39a42b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:58.665748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-8e6c30a8-351d-417f-baa8-a0a1dabc3ca4 req-73c391bb-9df2-4aaf-bf33-ba9d2d39a42b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:58.677242 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-8e6c30a8-351d-417f-baa8-a0a1dabc3ca4 req-73c391bb-9df2-4aaf-bf33-ba9d2d39a42b service nova] Creating event network-changed:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:07:58.682274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-8e6c30a8-351d-417f-baa8-a0a1dabc3ca4 req-73c391bb-9df2-4aaf-bf33-ba9d2d39a42b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Nov 19 15:07:58.683223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 312/737] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:07:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:07:59.006672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:59.007189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:59.013956 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.014412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.015291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.015775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.042674 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:07:59.057088 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:59.059899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:59.068587 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.069285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.070276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.070722 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.132058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-efee8f14-1633-4463-b2d7-cb6c1d4b2ab2 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 204 len: 0 microversion: 2.1 time: 0.128800 Nov 19 15:07:59.132946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 426/738] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:07:59 2021] DELETE /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:07:59.146017 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:07:59.146965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:07:59.154693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.156248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.157402 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:07:59.158003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:07:59.321410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:59.333014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:07:59.333557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb63245e-aa73-4c3f-86a9-689b6c4c34ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.281664 Nov 19 15:07:59.334360 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 313/739] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:59 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:07:59.362561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-991a3e36-bcf7-454e-9330-2efe2ac77183 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1514 microversion: 2.1 time: 0.225624 Nov 19 15:07:59.367285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 427/740] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:07:59 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:00.350679 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:00.351286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:00.357539 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:00.357984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:00.358751 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:00.359180 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:00.378969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:00.380318 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:00.387000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:00.387916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:00.388707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:00.389169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:00.499197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:00.507889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cfdaadd7-12d9-4983-8012-6caff6478543 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.160808 Nov 19 15:08:00.508701 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 314/741] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:00 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:00.542844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:00.550495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7ad1ff6e-c4d7-4fed-884d-32272d00098b tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1514 microversion: 2.1 time: 0.175050 Nov 19 15:08:00.551047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 428/742] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:00 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:01.525747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:01.526363 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:01.533217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:01.533750 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:01.534552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:01.534996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:01.567086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:01.567799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:01.574277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:01.574833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:01.576171 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:01.576812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:01.670839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:01.678562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5083e67b-a622-403e-8aaf-493d649f1f61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.156404 Nov 19 15:08:01.679124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 315/743] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:01 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:01.712763 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:01.720078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d7e07da6-ddfe-4c01-b63d-e904ca6f22af tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1514 microversion: 2.1 time: 0.156604 Nov 19 15:08:01.720629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 429/744] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:01 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:02.696058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:02.696665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:02.703381 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:02.703829 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:02.704597 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:02.705055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:02.736898 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:02.737500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:02.743872 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:02.744560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:02.746041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:02.746041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:02.836291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:02.844690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-caba9fb2-f244-4f54-a661-20cf431f7db5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.152289 Nov 19 15:08:02.845290 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 316/745] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:02 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:02.877115 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:02.884360 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-08b15508-6f06-481c-96d9-59202ed2eeff tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1514 microversion: 2.1 time: 0.151209 Nov 19 15:08:02.884961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 430/746] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:02 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:03.862761 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:03.863485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:03.869908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:03.872058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:03.873527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:03.874163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:03.901992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:03.902601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:03.910328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:03.910790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:03.911756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:03.912185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:04.111282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:04.119076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7b73d03a-5893-44e3-96a0-06c787c41f5d tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1514 microversion: 2.1 time: 0.220923 Nov 19 15:08:04.119809 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 431/747] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:03 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:04.144661 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:04.152784 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1e2ffc1-f53d-46df-90a5-f6d7e93b8f08 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.294318 Nov 19 15:08:04.153466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 317/748] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:03 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:04.888581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-93a2415f-e383-4503-a6eb-04e0a67e78d4 req-bcb24829-1d30-465b-9497-8a9b03c4db15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d137ea7-786a-4fb3-bb1f-95d526175a90", "name": "network-vif-deleted", "tag": "94209437-90e5-4185-8bfb-c299b5e4e597"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:04.890221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:04.890221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:08:04.897546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-93a2415f-e383-4503-a6eb-04e0a67e78d4 req-bcb24829-1d30-465b-9497-8a9b03c4db15 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:04.897914 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-93a2415f-e383-4503-a6eb-04e0a67e78d4 req-bcb24829-1d30-465b-9497-8a9b03c4db15 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:04.908821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-93a2415f-e383-4503-a6eb-04e0a67e78d4 req-bcb24829-1d30-465b-9497-8a9b03c4db15 service nova] Creating event network-vif-deleted:94209437-90e5-4185-8bfb-c299b5e4e597 for instance 5d137ea7-786a-4fb3-bb1f-95d526175a90 on hv-cinder-81757 Nov 19 15:08:04.913413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-93a2415f-e383-4503-a6eb-04e0a67e78d4 req-bcb24829-1d30-465b-9497-8a9b03c4db15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028644 Nov 19 15:08:04.913977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 432/749] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:08:05.135556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:05.136158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:05.142396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:05.142870 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:05.143646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:05.144073 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:05.173540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:05.174611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:05.181889 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:05.182818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:05.184174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:05.184830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:05.211580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:05.220378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c255e90b-7034-46ef-b8b2-2e67232fe0bb tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1472 microversion: 2.1 time: 0.088372 Nov 19 15:08:05.229989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 318/750] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:05 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:05.330616 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:05.339768 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8099c2b3-5f0d-4640-9f54-d05388f8dbf0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.172402 Nov 19 15:08:05.340349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 433/751] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:05 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:06.238007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:06.238623 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:06.244883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:06.245339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:06.246124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:06.246566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:06.304686 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:06.312960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3892890f-7eab-4400-bd8e-65dcfeff2b0a tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1302 microversion: 2.1 time: 0.078689 Nov 19 15:08:06.313531 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 319/752] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:06 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1302 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:06.357001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:06.358200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:06.364710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:06.365197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:06.365970 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:06.366401 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:06.495772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:06.505842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4451a420-ef65-46cc-94fb-6dad611ebcf2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.152423 Nov 19 15:08:06.506416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 434/753] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:06 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:07.330324 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:07.330944 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:07.337147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:07.337838 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:07.338602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:07.339027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:07.398867 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4aff19ddd54325b884984bb6ddc144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53995b55564a4b2784260772caeedf05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:07.407617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d8ba8862-537f-409b-84c7-32e50f79ef50 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 200 len: 1302 microversion: 2.1 time: 0.081667 Nov 19 15:08:07.408173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 320/754] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:07 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:07.522084 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:07.522686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:07.529030 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:07.529536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:07.530355 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:07.530787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:07.662310 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:07.670865 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ed931192-150a-4e5e-8cdf-625a6f0422b9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.152126 Nov 19 15:08:07.671436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 435/755] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:07 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:08.423421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:08.423951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] [instance: 5d137ea7-786a-4fb3-bb1f-95d526175a90] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:08.430158 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:08.430601 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:08.431365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:08.431797 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:08.445006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] HTTP exception thrown: Instance 5d137ea7-786a-4fb3-bb1f-95d526175a90 could not be found. Nov 19 15:08:08.445581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] Returning 404 to user: Instance 5d137ea7-786a-4fb3-bb1f-95d526175a90 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:08:08.446376 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a3eb9ff-effe-4dfa-bf3c-44df4f820a67 tempest-AttachVolumeNegativeTest-1544554990 tempest-AttachVolumeNegativeTest-1544554990-project] 10.222.0.20 "GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90" status: 404 len: 111 microversion: 2.1 time: 0.026948 Nov 19 15:08:08.446890 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 321/756] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:08 2021] GET /compute/v2.1/servers/5d137ea7-786a-4fb3-bb1f-95d526175a90 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:08:08.687976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:08.688622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:08.694916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:08.695840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:08.696636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:08.697153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:08.851748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:08.871558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ccbe8b91-f52c-4621-89d4-6e3a3905b75d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1723 microversion: 2.1 time: 0.187369 Nov 19 15:08:08.876631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 436/757] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:08 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:09.903667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:09.904932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:09.911204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:09.911665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:09.912854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:09.913303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:10.065965 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:10.074078 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-20a88de9-bc2a-4eca-85d7-265e16d65a48 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1700 microversion: 2.1 time: 0.174909 Nov 19 15:08:10.074745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 322/758] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:09 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:10.090394 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2dec1254-3b30-4453-914d-0a8c3ce0ba66 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:10.097690 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dec1254-3b30-4453-914d-0a8c3ce0ba66 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:10.098183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2dec1254-3b30-4453-914d-0a8c3ce0ba66 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:10.164292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2dec1254-3b30-4453-914d-0a8c3ce0ba66 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Going to try to start instance {{(pid=116265) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 15:08:10.207620 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2dec1254-3b30-4453-914d-0a8c3ce0ba66 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 202 len: 0 microversion: 2.1 time: 0.120904 Nov 19 15:08:10.208536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 437/759] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:08:10 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:08:10.216648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:10.217676 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:10.223497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:10.223958 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:10.224749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:10.225220 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:10.390181 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:10.401646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-07f587d0-74f5-4d96-ab6f-fa82b95cb972 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1709 microversion: 2.1 time: 0.189022 Nov 19 15:08:10.402303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 323/760] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:10 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:11.419888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:11.420926 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:11.428464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:11.428940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:11.429761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:11.430221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:11.593044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:11.600721 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f5eccaa-2bc1-4062-bcfc-8931fe721075 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1709 microversion: 2.1 time: 0.185335 Nov 19 15:08:11.601328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 438/761] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:11 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:11.898769 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:11.899259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:11.905662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:11.906093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:11.906915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:11.907352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:11.989566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lazy-loading 'services' on Instance uuid 25019dc4-beca-4211-ab7d-0121784e29db {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:08:12.060740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4180975-9b8e-4f76-b38f-7e2cdd7a35fb tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db/os-volume_attachments/13fa07ad-fae2-4dc8-911a-73c4cb2d28f0" status: 202 len: 0 microversion: 2.1 time: 0.165244 Nov 19 15:08:12.061426 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 324/762] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:08:11 2021] DELETE /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db/os-volume_attachments/13fa07ad-fae2-4dc8-911a-73c4cb2d28f0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:08:12.618059 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:12.618720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:12.626447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:12.627203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:12.628104 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:12.628660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:12.797205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:12.806657 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-63045426-1ebd-4757-ac86-0483afd45c02 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1713 microversion: 2.1 time: 0.192556 Nov 19 15:08:12.807663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 439/763] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:12 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1713 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:13.175959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:13.176534 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:13.182561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:13.183093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:13.183873 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:13.184492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:13.208206 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:08:13.288892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ab7be1d-ba61-4d8f-bcf8-6e763bed8f70 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 204 len: 0 microversion: 2.1 time: 0.117236 Nov 19 15:08:13.289635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 325/764] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:08:13 2021] DELETE /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:08:13.298398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:13.299108 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:13.305372 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:13.305918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:13.306781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:13.307290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:13.448309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:13.456126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ec4fd12e-53c7-4fc2-bfc3-7aefab643951 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1512 microversion: 2.1 time: 0.161536 Nov 19 15:08:13.467416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 440/765] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:13 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:14.475889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:14.476676 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:14.483646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:14.484097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:14.484899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:14.485356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:14.627118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:14.634453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4191cea9-81b5-490c-a92f-d4e1a4b81684 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1512 microversion: 2.1 time: 0.163251 Nov 19 15:08:14.635359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 326/766] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:14 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:15.651683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:15.653021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:15.661433 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:15.662794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:15.664086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:15.664762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:15.817492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9ca6d0907d46d9a96726414a4ae6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec73be0ed44740b1d7128823a86838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:15.824822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ad03b080-8a2b-436d-9793-504ceedb7941 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 200 len: 1512 microversion: 2.1 time: 0.176972 Nov 19 15:08:15.825388 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 441/767] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:15 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:16.017529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-df0f07fa-9220-40f5-bdcc-00ee50f5cf4c req-053aeaf9-a62b-4357-9c45-d14f372cf4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25019dc4-beca-4211-ab7d-0121784e29db", "name": "network-vif-deleted", "tag": "fb69f7a6-919b-4c48-a8f6-98d1dac444f5"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:16.019146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:16.019146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:08:16.026511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-df0f07fa-9220-40f5-bdcc-00ee50f5cf4c req-053aeaf9-a62b-4357-9c45-d14f372cf4ab service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:16.027015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-df0f07fa-9220-40f5-bdcc-00ee50f5cf4c req-053aeaf9-a62b-4357-9c45-d14f372cf4ab service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:16.038435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-df0f07fa-9220-40f5-bdcc-00ee50f5cf4c req-053aeaf9-a62b-4357-9c45-d14f372cf4ab service nova] Creating event network-vif-deleted:fb69f7a6-919b-4c48-a8f6-98d1dac444f5 for instance 25019dc4-beca-4211-ab7d-0121784e29db on hv-cinder-81757 Nov 19 15:08:16.043068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-df0f07fa-9220-40f5-bdcc-00ee50f5cf4c req-053aeaf9-a62b-4357-9c45-d14f372cf4ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029466 Nov 19 15:08:16.043659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 327/768] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:08:16.842455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:16.843844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] [instance: 25019dc4-beca-4211-ab7d-0121784e29db] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:16.853719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:16.854423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:16.855799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:16.856261 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:16.876222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] HTTP exception thrown: Instance 25019dc4-beca-4211-ab7d-0121784e29db could not be found. Nov 19 15:08:16.876222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] Returning 404 to user: Instance 25019dc4-beca-4211-ab7d-0121784e29db could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:08:16.876222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f61b8d03-6645-4f53-83ac-83105d89da22 tempest-VolumesSnapshotTestJSON-273307365 tempest-VolumesSnapshotTestJSON-273307365-project] 10.222.0.20 "GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db" status: 404 len: 111 microversion: 2.1 time: 0.035470 Nov 19 15:08:16.876222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 442/769] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:16 2021] GET /compute/v2.1/servers/25019dc4-beca-4211-ab7d-0121784e29db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:08:34.798813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:34.800027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:34.806090 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:34.806523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:34.807298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:34.807737 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:34.838096 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a767ee2-77ae-419b-acf0-a423ba4f16f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments/9590d674-9e3a-4d29-aea4-93657ea85b8d" status: 200 len: 194 microversion: 2.20 time: 0.044473 Nov 19 15:08:34.838985 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 328/770] 10.222.0.20 () {60 vars in 1453 bytes} [Fri Nov 19 15:08:34 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments/9590d674-9e3a-4d29-aea4-93657ea85b8d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:08:34.918253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:34.918963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:34.927857 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:34.928642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:34.929969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:34.930490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:35.016944 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lazy-loading 'services' on Instance uuid 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:08:35.123649 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fdd393bb-13c7-487f-8a71-2a0366a7bb56 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments/9590d674-9e3a-4d29-aea4-93657ea85b8d" status: 202 len: 0 microversion: 2.20 time: 0.209296 Nov 19 15:08:35.124597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 443/771] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Nov 19 15:08:34 2021] DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments/9590d674-9e3a-4d29-aea4-93657ea85b8d => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:08:35.134390 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:35.135713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:35.156992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:35.159231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:35.161845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:35.163303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:35.207011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-765a417f-67be-4cc6-8713-20d5d1f2f50d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077836 Nov 19 15:08:35.207876 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 329/772] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Nov 19 15:08:35 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:08:36.221038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:36.222255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:36.228739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.229220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.230014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.230454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.261758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5182f239-3728-4a4f-a7ad-c09f76d7f315 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046501 Nov 19 15:08:36.262522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 444/773] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Nov 19 15:08:36 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:36.322562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:36.323209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:36.331120 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.331501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.332348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.332809 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.361523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:08:36.452702 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-03bed402-2b53-453a-971d-33f196ecbdb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 204 len: 0 microversion: 2.20 time: 0.133781 Nov 19 15:08:36.454193 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 330/774] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Nov 19 15:08:36 2021] DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:08:36.462720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:36.463319 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:36.471064 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.471519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.472312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:36.472754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:36.619927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:36.627877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:36.629480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:36.630622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-036ae183-1601-4217-b895-35ce23e14eb1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.172051 Nov 19 15:08:36.631172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 445/775] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:36 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:37.650012 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:37.650710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:37.657602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:37.658047 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:37.658827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:37.659264 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:37.840463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:37.849101 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:37.850609 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:37.851774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb195189-850f-4973-a8b8-bdde58ab13a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.205849 Nov 19 15:08:37.852645 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 331/776] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:37 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:38.870391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:38.871102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:38.882303 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:38.883513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:38.885101 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:38.886702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:39.064900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:39.073853 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:39.076096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:39.077434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f0eaac56-8f67-409d-8013-339df3688508 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 200 len: 1721 microversion: 2.20 time: 0.210956 Nov 19 15:08:39.078054 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 446/777] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:38 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:39.535465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-fbe5aad2-95e0-474f-aa47-4e5d4f238c41 req-2de0810b-4f5a-41a8-90fa-39250b050c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084f3bb6-2fa2-4b60-985e-61c8b8f2fc82", "name": "network-vif-deleted", "tag": "474c9f67-fb9a-42a4-8ae6-f2786e33ea63"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:39.538015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:39.538015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:08:39.546443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fbe5aad2-95e0-474f-aa47-4e5d4f238c41 req-2de0810b-4f5a-41a8-90fa-39250b050c12 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:39.546887 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fbe5aad2-95e0-474f-aa47-4e5d4f238c41 req-2de0810b-4f5a-41a8-90fa-39250b050c12 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:39.558818 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-fbe5aad2-95e0-474f-aa47-4e5d4f238c41 req-2de0810b-4f5a-41a8-90fa-39250b050c12 service nova] Creating event network-vif-deleted:474c9f67-fb9a-42a4-8ae6-f2786e33ea63 for instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 on hv-cinder-81757 Nov 19 15:08:39.563785 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-fbe5aad2-95e0-474f-aa47-4e5d4f238c41 req-2de0810b-4f5a-41a8-90fa-39250b050c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 Nov 19 15:08:39.564935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 332/778] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:08:40.098691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:40.100739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:40.121026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:40.121965 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:40.126172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:40.126639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:40.177699 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. Nov 19 15:08:40.180627 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:08:40.182743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b1516259-c8af-4271-b75e-b8222068c216 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 404 len: 111 microversion: 2.20 time: 0.088063 Nov 19 15:08:40.184488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 447/779] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:40 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:08:40.197520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa0fbd43-dab7-4efd-a799-704f8a59a9a3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '.version_select at 0x7f37c7494af0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:40.242773 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa0fbd43-dab7-4efd-a799-704f8a59a9a3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641720134" status: 204 len: 0 microversion: 2.20 time: 0.049939 Nov 19 15:08:40.243749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 333/780] 10.222.0.20 () {60 vars in 1261 bytes} [Fri Nov 19 15:08:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641720134 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:08:41.390557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: .version_select at 0x7f37c7540280>, body: {"keypair": {"name": "tempest-keypair-1165647573"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:41.407488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:08:41.412225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:08:41.776202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:08:41.781606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:08:41.798475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-eb3f6cfe-9ac5-4127-94d9-49dc09a6da43 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.411707 Nov 19 15:08:41.799288 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 448/781] 10.222.0.20 () {62 vars in 1198 bytes} [Fri Nov 19 15:08:41 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:08:42.132915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:42.134547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:42.141972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:42.142581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:42.143738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:42.144175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:42.230666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-863468b6-b2d8-4610-b258-7bea074f8459 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action" status: 202 len: 0 microversion: 2.1 time: 0.101346 Nov 19 15:08:42.232718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 334/782] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:08:42 2021] POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:08:42.240416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:42.241697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:42.250708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:42.251369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:42.252262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:42.254940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:42.482121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:42.490706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ae7c0b04-e36d-462f-b966-8c41b63c470e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1749 microversion: 2.1 time: 0.254140 Nov 19 15:08:42.492250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 449/783] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:42 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:43.512490 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:43.514533 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:43.524744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:43.526076 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:43.527320 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:43.527804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:43.943507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:43.953143 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-694cd2b0-b807-42cc-b9ca-037d1b562b46 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.445339 Nov 19 15:08:43.953807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 335/784] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:43 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:44.090621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-542690568", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f97c391d-7c3e-4d86-a9cf-5e771e36f18c"}], "security_groups": [{"name": "tempest-securitygroup--1467803709"}], "key_name": "tempest-keypair-1165647573", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:44.252592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] validate_networks() for [('f97c391d-7c3e-4d86-a9cf-5e771e36f18c', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:08:44.730071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:08:44.730497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:08:44.730975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:08:44.732009 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:08:44.732443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:08:44.741432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:44.741889 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:44.742714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:44.743167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:44.761595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:08:44.766581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Getting quotas for user 6b5aa6372ec74ca4bed7cb5cf1677e8d and project 5eaa9bd6803a47d79c92591db12100ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:08:44.777765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:08:44.780743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:08:44.830346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8dd148c5-3ea2-41ec-8640-7588aef6355f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.743928 Nov 19 15:08:44.833062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 450/785] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Nov 19 15:08:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 15:08:44.842297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:44.843525 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:44.971671 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:44.972382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:44.979162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:44.979623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:44.980430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:44.980903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:45.065996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:45.074705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:45.082664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:45.086049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b135b2b6-0720-44b0-8d27-227e6e742586 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1281 microversion: 2.20 time: 0.248310 Nov 19 15:08:45.087744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 336/786] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:44 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1281 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:45.151076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:45.159290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2c9a7541-b6f9-4640-9c72-c059c22f64b4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.191301 Nov 19 15:08:45.159993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 451/787] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:44 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:46.104666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:46.106342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:46.115134 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:46.115911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:46.116913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:46.117541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:46.179947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:46.181993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:46.193091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:46.194492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:46.195525 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:46.196221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:46.232024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:46.240300 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:46.242201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:46.243521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fcbacd13-45b3-4830-9fb8-edf476291589 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1339 microversion: 2.20 time: 0.142550 Nov 19 15:08:46.244552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 337/788] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:46 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:46.372695 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:46.383937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dee95dde-2c78-401c-b670-c4cc6cd22a7a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.210785 Nov 19 15:08:46.384576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 452/789] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:46 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:47.263040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:47.264588 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:47.271209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:47.271951 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:47.273270 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:47.273974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:47.402669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:47.404580 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:47.417864 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:47.418906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:47.420412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:47.421089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:47.527648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:47.545066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:47.545066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:47.547064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c946da05-6634-4dca-87b9-e663d6d90b9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.288046 Nov 19 15:08:47.547682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 338/790] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:47 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:47.661600 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:47.676243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c2400988-2c90-4eab-b736-0ff88b76db31 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.277451 Nov 19 15:08:47.676873 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 453/791] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:47 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:47.756523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-cc0adb4a-2fd6-4843-90e3-39b662cb074e req-36d08ed0-a3bc-45bf-bfc4-2e67b5c6b2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:47.758288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:47.758288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:08:47.772623 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-cc0adb4a-2fd6-4843-90e3-39b662cb074e req-36d08ed0-a3bc-45bf-bfc4-2e67b5c6b2bf service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:47.773116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-cc0adb4a-2fd6-4843-90e3-39b662cb074e req-36d08ed0-a3bc-45bf-bfc4-2e67b5c6b2bf service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:47.786104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-cc0adb4a-2fd6-4843-90e3-39b662cb074e req-36d08ed0-a3bc-45bf-bfc4-2e67b5c6b2bf service nova] Creating event network-changed:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:08:47.793542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-cc0adb4a-2fd6-4843-90e3-39b662cb074e req-36d08ed0-a3bc-45bf-bfc4-2e67b5c6b2bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040461 Nov 19 15:08:47.794568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 339/792] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:08:48.565938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:48.566649 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:48.573880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:48.574418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:48.575867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:48.576517 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:48.694695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:48.705765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:48.725512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:48.728628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:48.729962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:48.730766 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:48.768927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:48.779390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:48.781385 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:48.783297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f2c2427b-2e06-41e7-8b95-807ba5a62f7a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.221030 Nov 19 15:08:48.785231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 454/793] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:48 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:48.907968 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:48.915792 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ae3614fa-2f97-436e-8164-53f229b533f0 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.225327 Nov 19 15:08:48.916349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 340/794] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:48 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:49.801966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:49.802476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:49.808689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:49.809163 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:49.809992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:49.810506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:49.935319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:49.935942 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:49.942055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:49.942425 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:49.943211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:49.943646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:49.948282 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:49.959293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:49.960952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:49.962445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-16d3c455-ec5e-4b11-a29f-3588e6b37fc8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.164164 Nov 19 15:08:49.963092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 455/795] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:49 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:50.093540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:50.101295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-60e3a4c4-d873-418e-b1e4-cc016dc4908f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.169666 Nov 19 15:08:50.101937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 341/796] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:49 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:50.980584 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:50.981647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:50.988087 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:50.988575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:50.989396 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:50.989840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:51.118942 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:51.119561 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:51.126225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:51.126663 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:51.127119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:51.127896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:51.128329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:51.133858 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:51.135358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:51.136449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a6cd528d-97b3-45f0-ab4c-06a62f904cd8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.159591 Nov 19 15:08:51.137032 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 456/797] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:50 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:51.271554 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:51.279873 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d013d88a-69a1-48fa-ad6b-e68ff99f35cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.165045 Nov 19 15:08:51.280440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 342/798] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:51 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:52.153294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:52.154058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:52.160490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:52.160975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:52.161757 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:52.162191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:52.292294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:52.296813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:52.297458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:52.300760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:52.302291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:52.303518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-44f10c2c-b2c8-47d2-8a7a-6d08b2b03ec5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.153873 Nov 19 15:08:52.303757 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:52.304057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 457/799] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:52 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:52.304186 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:52.304999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:52.305433 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:52.448214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:52.455852 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26446f64-3db2-4836-b8ca-f14dd44632ea tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.163288 Nov 19 15:08:52.456414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 343/800] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:52 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:53.321938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:53.322541 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:53.329615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:53.330063 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:53.330846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:53.331277 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:53.464813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:53.472507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:53.473140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:53.473391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:53.474931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:53.476066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-54600fc8-adce-40a0-930a-207df3b74833 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.157821 Nov 19 15:08:53.476614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 458/801] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:53 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:53.479041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:53.479496 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:53.480306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:53.480714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:53.627081 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:53.635002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f586153-9a5c-4f7e-bbcf-82b359d60236 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.166095 Nov 19 15:08:53.635594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 344/802] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:53 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:53.679169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-9396be26-c79d-4bf1-8f67-d9fafb887102 req-0a40488f-e179-4c79-8fea-cca9c0022715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "name": "network-vif-plugged", "status": "completed", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:53.680751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:53.680751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:08:53.688072 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9396be26-c79d-4bf1-8f67-d9fafb887102 req-0a40488f-e179-4c79-8fea-cca9c0022715 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:53.688494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9396be26-c79d-4bf1-8f67-d9fafb887102 req-0a40488f-e179-4c79-8fea-cca9c0022715 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:53.700769 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-9396be26-c79d-4bf1-8f67-d9fafb887102 req-0a40488f-e179-4c79-8fea-cca9c0022715 service nova] Creating event network-vif-plugged:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:08:53.706162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-9396be26-c79d-4bf1-8f67-d9fafb887102 req-0a40488f-e179-4c79-8fea-cca9c0022715 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Nov 19 15:08:53.706741 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 459/803] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:08:54.493907 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:54.494639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:54.501783 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:54.502243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:54.503147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:54.503650 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:54.639924 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:54.648182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:54.649771 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:54.650913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5d9432a3-f2ad-4452-83d8-5762ff0691a8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1407 microversion: 2.20 time: 0.160892 Nov 19 15:08:54.651416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 345/804] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:54 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:54.654075 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:54.655730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:54.662184 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:54.662691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:54.663680 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:54.664128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:54.977866 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:54.985813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-96300e26-9e5c-4863-aa3e-a3392b125618 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.336674 Nov 19 15:08:54.986379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 460/805] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:54 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:55.121922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:55.122649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:55.129197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.129644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:55.130417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.130850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:55.212866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lazy-loading 'services' on Instance uuid 28d60727-6b69-40d5-81e4-79f73038581b {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:08:55.286372 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23ce784d-3e8b-4abf-8eb9-2f266b31863d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments/2910883e-1c8e-49a8-835d-3ed7e7a497a3" status: 202 len: 0 microversion: 2.1 time: 0.167991 Nov 19 15:08:55.287307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 346/806] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:08:55 2021] DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments/2910883e-1c8e-49a8-835d-3ed7e7a497a3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:08:55.669202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:55.670513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:55.677139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.677594 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:55.678387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.678860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:55.817179 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:55.824777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:55.827087 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:55.828249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dcd2dbb2-7ce5-4762-b843-008eec72cef1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1599 microversion: 2.20 time: 0.162824 Nov 19 15:08:55.829111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 461/807] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:08:55 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:08:55.846851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:55.847602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:55.853639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.854089 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:55.854876 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:55.855309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.004094 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:56.005071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:56.011291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:56.012041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.013112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:56.014121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.172428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:56.180415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a09634a8-e526-44ac-a5fd-2e6b46a8cf73 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.179949 Nov 19 15:08:56.181141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 462/808] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:55 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:56.212000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d54da14d-6fb9-48f8-aa39-fdb56a408c41 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.369639 Nov 19 15:08:56.212701 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 347/809] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Nov 19 15:08:55 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:08:56.421253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cc3199e1-e22b-4d34-baec-4b883eda9df4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:56.426954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc3199e1-e22b-4d34-baec-4b883eda9df4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:56.427485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc3199e1-e22b-4d34-baec-4b883eda9df4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.451819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cc3199e1-e22b-4d34-baec-4b883eda9df4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Going to try to stop instance {{(pid=116265) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 15:08:56.515805 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cc3199e1-e22b-4d34-baec-4b883eda9df4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 202 len: 0 microversion: 2.1 time: 0.099133 Nov 19 15:08:56.516671 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 463/810] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:08:56 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:08:56.528298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:56.529671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:56.537597 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:56.538366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.539298 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:56.539804 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:56.954293 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:56.964027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dac4093c-0dff-4a19-a85e-176af4616701 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.439357 Nov 19 15:08:56.965213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 348/811] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:56 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:08:57.199980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:57.202089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:57.210507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.211216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.212303 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.212748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.397651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:57.406187 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9a5af7b1-47de-43ad-a68f-0e185b882f96 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.210708 Nov 19 15:08:57.406771 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 464/812] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:57 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:57.800265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:57.801341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:57.802445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-e2e46ebe-c81e-4a6f-b8a6-fe8e95cc6297 req-7705fdb7-ffaa-49d4-99d5-bfbbd74450d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:57.804040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:08:57.804040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:08:57.807445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.807898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.808684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.809165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.811434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e2e46ebe-c81e-4a6f-b8a6-fe8e95cc6297 req-7705fdb7-ffaa-49d4-99d5-bfbbd74450d2 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.811987 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e2e46ebe-c81e-4a6f-b8a6-fe8e95cc6297 req-7705fdb7-ffaa-49d4-99d5-bfbbd74450d2 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.823082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-e2e46ebe-c81e-4a6f-b8a6-fe8e95cc6297 req-7705fdb7-ffaa-49d4-99d5-bfbbd74450d2 service nova] Creating event network-changed:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:08:57.828972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-e2e46ebe-c81e-4a6f-b8a6-fe8e95cc6297 req-7705fdb7-ffaa-49d4-99d5-bfbbd74450d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030345 Nov 19 15:08:57.829969 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 465/813] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:08:57.875318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9131ba3d-48c0-4ba1-827f-344f9af8a5ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.079448 Nov 19 15:08:57.876695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 349/814] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:08:57 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:57.985478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:57.986564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:57.993085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.993673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:57.994575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:57.995686 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:58.143350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:58.152101 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b7f7d26c-8530-4c0b-9c99-a951adaafcf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.170565 Nov 19 15:08:58.152687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 466/815] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:57 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:58.425408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:58.426051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:58.433237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:58.433687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:58.434667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:58.435096 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:58.589826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:58.598831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-92178aaa-70a0-4db7-acd9-fd7ccc7479f2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1754 microversion: 2.1 time: 0.177572 Nov 19 15:08:58.599532 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 350/816] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:58 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:58.887534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:08:58.889437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:58.898097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:58.898974 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:58.900448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:58.901750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:59.024973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c54d8ded-e91d-42cf-8deb-f2a00858e123 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.141380 Nov 19 15:08:59.025613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 467/817] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:08:58 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:59.170892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:59.171491 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:59.177841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:59.178294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:59.179064 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:59.179494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:59.313107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:59.320341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b661cdcd-e019-4de3-b9c7-61b156524319 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.153773 Nov 19 15:08:59.320936 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 351/818] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:59 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:08:59.616266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:08:59.616987 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:08:59.624520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:59.625004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:59.625780 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:08:59.626219 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:08:59.767434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:08:59.775283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b957ddd6-20ed-4f89-b559-b8728477ce5b tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1757 microversion: 2.1 time: 0.163137 Nov 19 15:08:59.775850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 468/819] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:08:59 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:00.035511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:00.036470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:00.042352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:00.042798 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:00.043569 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:00.044002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:00.111450 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e8f0a564-0878-4389-be6b-9101f13d4258 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.079337 Nov 19 15:09:00.114662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 352/820] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:00 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:00.338951 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:00.339568 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:00.346674 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:00.347163 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:00.348008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:00.348475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:00.480049 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:00.488117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8ae8f124-f4fd-4b97-bd25-e458a87dc6e3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.154058 Nov 19 15:09:00.488684 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 469/821] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:00 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:01.123744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:01.124808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:01.132007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:01.132463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:01.133334 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:01.133776 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:01.199004 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ece8cff6-a3d1-4e3d-8abb-f2fad4402a4e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.079676 Nov 19 15:09:01.202147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 353/822] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:01 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:01.505245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:01.505794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:01.511870 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:01.512314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:01.513118 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:01.513593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:01.643742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:01.650918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4dcb796c-432c-4688-9426-9b6a791b3a3c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.149601 Nov 19 15:09:01.651479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 470/823] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:01 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:02.209745 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:02.210781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:02.218560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:02.219007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:02.219788 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:02.220226 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:02.282662 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2d07fdef-cc4a-4d02-a073-d608b509f5b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.076762 Nov 19 15:09:02.285931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 354/824] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:02 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:02.667315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:02.668000 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:02.674454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:02.674838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:02.675627 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:02.676077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:02.805006 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:02.813078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1cabc13f-89e6-45d6-b469-b64fdf408752 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.149431 Nov 19 15:09:02.813672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 471/825] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:02 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:03.293574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:03.295013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:03.301947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:03.302396 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:03.303184 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:03.303625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:03.363967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4f54c06-32af-4758-92cc-90b7f722b3c4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.074537 Nov 19 15:09:03.364582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 355/826] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:03 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:09:03.830587 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:03.831128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:03.838387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:03.838834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:03.839615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:03.840045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:03.982584 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:03.989725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-529c08f1-933d-409b-97fe-6644e2c58f63 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.162912 Nov 19 15:09:03.990283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 472/827] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:03 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:04.375424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:04.376343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:04.383213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:04.383663 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:04.384440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:04.384910 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:05.007458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:05.008004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:05.014957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:05.015406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:05.016183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:05.016620 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:05.148278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:05.156510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4b6b0c63-3af7-4631-9dc0-8fcf87b4e2b4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.152727 Nov 19 15:09:05.157117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 473/828] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:05 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:09:06.173597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:06.174217 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:06.180445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:06.180940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:06.181720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:06.182158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:06.308368 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:06.316323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-544c174b-2bcb-491b-8787-ca8347f8b3c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1677 microversion: 2.1 time: 0.146991 Nov 19 15:09:06.316909 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 474/829] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:06 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:09:07.138882 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9168001-1bc0-4927-80ce-1e3b44bde30f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 2.766877 Nov 19 15:09:07.139583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 356/830] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:04 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:07.333371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:07.333972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:07.340707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:07.341187 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:07.342691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:07.343117 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:07.473447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:07.480982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-26d4d626-4052-4e1a-9073-9f6f8f498d73 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1654 microversion: 2.1 time: 0.151265 Nov 19 15:09:07.481540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 475/831] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:07 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:07.498507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28f845cd-b700-43d9-a9c1-1698f380c107 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:07.506011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28f845cd-b700-43d9-a9c1-1698f380c107 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:07.506498 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28f845cd-b700-43d9-a9c1-1698f380c107 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:07.527801 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28f845cd-b700-43d9-a9c1-1698f380c107 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Going to try to start instance {{(pid=116266) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 15:09:07.567039 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28f845cd-b700-43d9-a9c1-1698f380c107 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action" status: 202 len: 0 microversion: 2.1 time: 0.072670 Nov 19 15:09:07.567633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 357/832] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:09:07 2021] POST /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:07.575465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:07.576213 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:07.582097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:07.582548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:07.583321 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:07.583825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:07.715464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:07.723018 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-228c828b-1906-4713-9ce2-8773e129271d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1663 microversion: 2.1 time: 0.151160 Nov 19 15:09:07.723636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 476/833] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:07 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:08.318639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:08.319769 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:08.325903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:08.326354 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:08.327196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:08.327630 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:08.406513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-939d261e-6739-4234-956d-3ca969886e67 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 14 microversion: 2.20 time: 0.260178 Nov 19 15:09:08.407147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 358/834] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:08 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 14 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:08.740431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:08.741716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:08.749013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:08.749653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:08.750447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:08.750945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:08.884719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:08.892582 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d4eaad43-6f48-4910-af0c-5c6bff5f13bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1667 microversion: 2.1 time: 0.155882 Nov 19 15:09:08.893207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 477/835] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:08 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:09.417814 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:09.418806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:09.426177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:09.426620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:09.427391 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:09.427825 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:09.500375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-782b3f07-521e-4ca6-aa5b-c99d4317db21 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 10610 microversion: 2.20 time: 0.086463 Nov 19 15:09:09.501006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 359/836] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:09 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 10610 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:10.511446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:10.512353 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:10.518550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:10.518995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:10.519762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:10.520199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:10.593511 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-41fd6384-0c7d-4be6-9e69-5fc2df9a3482 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 17354 microversion: 2.20 time: 0.085606 Nov 19 15:09:10.594124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 478/837] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:10 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 17354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:11.605065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:11.606054 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:11.613542 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:11.613987 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:11.614761 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:11.615194 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:11.698166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-581396f9-28f5-49f5-b9b4-de8f687d48d1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 18356 microversion: 2.20 time: 0.096974 Nov 19 15:09:11.698799 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 360/838] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:11 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 18356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:12.710143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:12.711597 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:12.721352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:12.721808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:12.722614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:12.723061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:12.812842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ea90070b-e869-4b9e-a7b0-46e601e7e49e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 20593 microversion: 2.20 time: 0.106603 Nov 19 15:09:12.813818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 479/839] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:12 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 20593 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:13.823955 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:13.825008 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:13.832319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:13.832760 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:13.833552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:13.833984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:13.909097 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-45566cab-66d0-40a7-b5d8-e5f19a30c262 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 22540 microversion: 2.20 time: 0.088964 Nov 19 15:09:13.909761 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 361/840] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:13 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 22540 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:14.922008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:14.923010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:14.929819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:14.930269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:14.931048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:14.931485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:15.005852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d1bca85d-81d3-49f5-a692-66fefaf0fb46 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 23798 microversion: 2.20 time: 0.088541 Nov 19 15:09:15.006407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 480/841] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:14 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 23798 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:16.017521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:16.018436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:16.025352 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:16.025802 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:16.026584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:16.027024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:16.119199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d55ed272-10d1-48aa-b88b-0d55150f4c34 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 24834 microversion: 2.20 time: 0.105759 Nov 19 15:09:16.119875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 362/842] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:16 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 24834 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:17.131430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:17.132422 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:17.139845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:17.140286 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:17.141111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:17.141545 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:17.241246 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0978d7dd-ad80-469c-8ab7-8fcee0446b32 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 25948 microversion: 2.20 time: 0.113415 Nov 19 15:09:17.242110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 481/843] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:17 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 25948 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:18.253458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:18.254491 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:18.261424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:18.261884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:18.262680 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:18.263712 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:18.357259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15595d7b-3a44-4061-a44c-13dfac00eedb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 26994 microversion: 2.20 time: 0.107189 Nov 19 15:09:18.357836 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 363/844] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:18 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 26994 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:19.369335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:19.370382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:19.377223 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:19.377669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:19.378448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:19.378878 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:19.461516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-36cd3681-9d02-4f58-ae00-d1061ba459b8 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 27558 microversion: 2.20 time: 0.095820 Nov 19 15:09:19.462162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 482/845] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:19 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 27558 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:20.478417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:20.479342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:20.486243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:20.486691 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:20.487472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:20.487908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:20.574024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3dbb6d1f-0e01-49d4-ac57-4613d1371111 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 27911 microversion: 2.20 time: 0.099634 Nov 19 15:09:20.574634 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 364/846] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:20 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 27911 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:21.586837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:21.587847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:21.595441 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:21.595892 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:21.596681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:21.597152 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:21.678760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3afae9a6-1565-4ddb-86db-74489fc0c057 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28165 microversion: 2.20 time: 0.096048 Nov 19 15:09:21.679432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 483/847] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:21 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28165 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:22.691231 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:22.692239 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:22.699033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:22.699484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:22.700313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:22.700853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:22.768267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2e746f5-6755-4012-9792-75dabe53cc83 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28165 microversion: 2.20 time: 0.080894 Nov 19 15:09:22.769166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 365/848] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:22 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28165 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:23.780182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:23.781387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:23.788278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:23.788776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:23.789628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:23.790118 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:23.885096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-248b1f6f-e38c-4137-b792-f8f4aa028077 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28456 microversion: 2.20 time: 0.109053 Nov 19 15:09:23.885752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 484/849] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:23 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28456 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:24.897732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:24.898726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:24.906824 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:24.907275 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:24.908063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:24.908494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:24.975721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15096c6c-81f4-4ab6-9492-aa7b425a88e6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28456 microversion: 2.20 time: 0.081828 Nov 19 15:09:24.976338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 366/850] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:24 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28456 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:25.987606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:25.988599 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:25.995382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:25.995825 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:25.996648 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:25.997783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:26.077431 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1ad7284d-7c62-4cc0-9c96-7412fe81f8ba tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28624 microversion: 2.20 time: 0.093643 Nov 19 15:09:26.078094 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 485/851] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:25 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28624 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:27.088981 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:27.090003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:27.097600 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:27.098100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:27.098937 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:27.099399 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:27.171320 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4aa93019-0dbc-492c-bca5-f177af924dad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28624 microversion: 2.20 time: 0.086517 Nov 19 15:09:27.171947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 367/852] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:27 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28624 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:28.183371 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:28.184425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:28.191942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:28.192392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:28.193204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:28.193639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:28.261467 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-19afb890-aef3-439f-be13-f76ea6b2d47d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28624 microversion: 2.20 time: 0.082062 Nov 19 15:09:28.262251 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 486/853] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:28 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28624 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:29.274063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:29.275062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:29.281973 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:29.282424 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:29.283201 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:29.283639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:29.353635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8618fe8f-315a-4b18-a831-bc11f6ca72a2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28624 microversion: 2.20 time: 0.083270 Nov 19 15:09:29.354325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 368/854] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:29 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28624 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:09:30.366400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:30.367392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:30.374400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:30.374845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:30.375617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:30.376046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:30.440854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d08ca849-8a8f-49a1-a8cf-adb2124f3ceb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 28624 microversion: 2.20 time: 0.078381 Nov 19 15:09:30.441639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 487/855] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:30 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 28624 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:31.452614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:31.453651 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:31.461582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:31.461582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:31.462060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:31.462486 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:31.551935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67e7b213-b785-4db3-a674-067cbe700a09 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 29158 microversion: 2.20 time: 0.103128 Nov 19 15:09:31.552530 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 369/856] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:31 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 29158 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:32.563850 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:32.564863 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:32.571702 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:32.572181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:32.572985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:32.573418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:32.654295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3d4d4ffc-f19a-42d4-95bb-7262503530cc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 30884 microversion: 2.20 time: 0.093529 Nov 19 15:09:32.658443 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 488/857] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:32 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 30884 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:33.666684 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:33.667693 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:33.675253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:33.675703 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:33.676483 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:33.676952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:33.757316 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9f98af3-9228-4251-b789-154cd2dfc27a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 32522 microversion: 2.20 time: 0.094407 Nov 19 15:09:33.757971 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 370/858] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:33 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 32522 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:34.769742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:34.770748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:34.777560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:34.778062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:34.779022 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:34.779461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:34.860559 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f08270c7-51e5-47d8-87fe-99c8fdc2dd45 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 33508 microversion: 2.20 time: 0.094679 Nov 19 15:09:34.861456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 489/859] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:34 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 33508 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:35.872757 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:35.874404 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:35.881227 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:35.881674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:35.882446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:35.882878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:35.959002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-304474f7-0d98-48d1-8c4d-11517024d767 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 34346 microversion: 2.20 time: 0.089820 Nov 19 15:09:35.959685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 371/860] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:35 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 34346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:36.970932 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:36.971977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:36.978880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:36.979337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:36.980147 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:36.980617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:37.067474 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dc4934bf-0d23-4eba-b6fe-f323e1df2b4c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 35297 microversion: 2.20 time: 0.101130 Nov 19 15:09:37.068086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 490/861] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:36 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 35297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:38.079099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:38.080100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:38.087214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:38.087657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:38.088427 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:38.088898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:38.177633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b4dff3e4-a911-490b-a121-23d009553611 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 36602 microversion: 2.20 time: 0.102546 Nov 19 15:09:38.178306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 372/862] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:38 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 36602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:38.817402 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1413447841"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:38.818010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:38.824821 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:38.825279 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:38.826052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:38.827278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:38.952828 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.network.security_group_api [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Removing security group b42cf0a5-1d18-486b-a0f6-fd5ef81f3cd3 from port d9cbc786-bc49-4094-b804-87076d431575 Nov 19 15:09:39.191784 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:39.192849 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:39.199465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:39.199848 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:39.200635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:39.201133 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:39.278463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-55646349-10ab-4e7f-9103-40ab4ffd62a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 37938 microversion: 2.20 time: 0.090605 Nov 19 15:09:39.279513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 373/863] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:39 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 37938 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:09:39.313463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-efdc9e4f-865f-4612-850b-4ef8daad00e9 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action" status: 202 len: 0 microversion: 2.1 time: 0.500098 Nov 19 15:09:39.314010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 491/864] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:09:38 2021] POST /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:39.562939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-3d48e1e3-bcce-4198-b577-64840a4276c4 req-b0a8fbb5-8cbd-4a7e-a654-4caac3588c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:39.565023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:09:39.565023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:09:39.573639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3d48e1e3-bcce-4198-b577-64840a4276c4 req-b0a8fbb5-8cbd-4a7e-a654-4caac3588c38 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:39.574335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3d48e1e3-bcce-4198-b577-64840a4276c4 req-b0a8fbb5-8cbd-4a7e-a654-4caac3588c38 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:39.585682 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-3d48e1e3-bcce-4198-b577-64840a4276c4 req-b0a8fbb5-8cbd-4a7e-a654-4caac3588c38 service nova] Creating event network-changed:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:09:39.591333 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-3d48e1e3-bcce-4198-b577-64840a4276c4 req-b0a8fbb5-8cbd-4a7e-a654-4caac3588c38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269646 Nov 19 15:09:39.593251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 374/865] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:09:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:09:40.291155 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:40.292043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:40.298711 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:40.299301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:40.299936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:40.300370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:40.374707 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-edd43b4e-f4cf-4510-b2a4-c01db60b027c tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 38171 microversion: 2.20 time: 0.087651 Nov 19 15:09:40.378870 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 492/866] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:40 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 38171 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:41.193642 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:41.194295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:41.202837 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.203371 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.204329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.204765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.266180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-c1106cb9-f2bf-4736-bb06-db65d6fdb726 req-492df87c-2074-42fe-8fbd-5be6f5869b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:41.267691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:09:41.267691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:09:41.278140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-c1106cb9-f2bf-4736-bb06-db65d6fdb726 req-492df87c-2074-42fe-8fbd-5be6f5869b66 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.278897 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-c1106cb9-f2bf-4736-bb06-db65d6fdb726 req-492df87c-2074-42fe-8fbd-5be6f5869b66 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.283021 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lazy-loading 'services' on Instance uuid 14d99f29-dbf8-45a9-8815-f96e0367bc65 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:09:41.290249 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-c1106cb9-f2bf-4736-bb06-db65d6fdb726 req-492df87c-2074-42fe-8fbd-5be6f5869b66 service nova] Creating event network-changed:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:09:41.295181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-c1106cb9-f2bf-4736-bb06-db65d6fdb726 req-492df87c-2074-42fe-8fbd-5be6f5869b66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103551 Nov 19 15:09:41.295964 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 493/867] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:09:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:09:41.360253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0496827f-e3af-4ae3-bdb0-958b822af0cd tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments/ce629b8f-6a38-4efe-8fa9-7daa93f38d04" status: 202 len: 0 microversion: 2.1 time: 0.171048 Nov 19 15:09:41.361203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 375/868] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:09:41 2021] DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments/ce629b8f-6a38-4efe-8fa9-7daa93f38d04 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:41.370614 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:41.371622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:41.379485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.380406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.381476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.382121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.387501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:41.389585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:41.397198 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.398351 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.399562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:41.400153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:41.429097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c09d3a7a-bb7d-44d2-86b4-0cbc9ccbe67e tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063179 Nov 19 15:09:41.430150 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 494/869] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:09:41 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:09:41.484194 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-235d8361-e8ea-4c84-bd82-6bf5430d9931 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 38171 microversion: 2.20 time: 0.099983 Nov 19 15:09:41.486617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 376/870] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:41 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 38171 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:42.441642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:42.442471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:42.448775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.449291 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.450071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.450507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.478515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c8efada7-325a-469e-97a4-6e80fda22c00 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040690 Nov 19 15:09:42.479061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 495/871] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:09:42 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:09:42.490488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:42.491077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:42.496458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:42.497406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:42.497659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.498305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.499178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.499620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.503219 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.503675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.504466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:42.504929 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:42.567770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-95ca4107-cb25-4c92-b0ed-8cee5b0b15c3 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 38171 microversion: 2.20 time: 0.074756 Nov 19 15:09:42.568399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 496/872] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:42 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 38171 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:09:42.572710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] HTTP exception thrown: Instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 is not attached to volume ce629b8f-6a38-4efe-8fa9-7daa93f38d04 Nov 19 15:09:42.573347 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Returning 404 to user: Instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 is not attached to volume ce629b8f-6a38-4efe-8fa9-7daa93f38d04 {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:09:42.574179 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d47249d0-36c8-442b-bdf8-1b0a248df156 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments/ce629b8f-6a38-4efe-8fa9-7daa93f38d04" status: 404 len: 154 microversion: 2.1 time: 0.088253 Nov 19 15:09:42.574720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 377/873] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:09:42 2021] DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65/os-volume_attachments/ce629b8f-6a38-4efe-8fa9-7daa93f38d04 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:09:43.580749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:43.581767 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:43.588760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.589232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.589999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.590429 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.670756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6278ac85-48b9-43e6-8f2e-748ad1e611dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 200 len: 38312 microversion: 2.20 time: 0.094286 Nov 19 15:09:43.671364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 497/874] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:43 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 38312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:09:43.680903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:43.681393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:43.688388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.688863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.689643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.690073 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.698886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:43.699462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:43.706734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.707181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.707954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.708387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.713807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b2c368d0-afe1-459f-a8c4-965bcf5705ef tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/ips" status: 200 len: 152 microversion: 2.20 time: 0.036523 Nov 19 15:09:43.714383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 378/875] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Nov 19 15:09:43 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:09:43.733205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:09:43.811233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4565b396-feec-409e-b96f-c20df58d5ef3 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 204 len: 0 microversion: 2.1 time: 0.115751 Nov 19 15:09:43.812045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 498/876] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:09:43 2021] DELETE /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:09:43.820537 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:43.821437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:43.828372 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.828874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.829664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:43.830105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:43.986742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:43.994267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-25c3f91a-3b15-4a9c-bdd9-d7a40d67233a tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1552 microversion: 2.1 time: 0.177700 Nov 19 15:09:43.994813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 379/877] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:43 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:45.012818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:45.013665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:45.020157 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:45.020612 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:45.021439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:45.021883 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:45.153263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:45.161515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5ca76630-e6fd-486e-90fc-8c9ab3b561e4 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1552 microversion: 2.1 time: 0.152685 Nov 19 15:09:45.162082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 499/878] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:45 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:45.872051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:45.872581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:45.879625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:45.880069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:45.880890 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:45.881323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:45.903412 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lazy-loading 'flavor' on Instance uuid ba17f361-87f8-4374-aa75-1a438c25b99f {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:09:46.159876 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-59661a65-dbf7-4a85-a73f-361d3f189eeb tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 202 len: 0 microversion: 2.20 time: 0.291279 Nov 19 15:09:46.163847 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 380/879] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:09:45 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:09:46.168462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:46.169139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:46.176295 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:46.176750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:46.177615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:46.178013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:46.191896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:46.192862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:46.201224 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:46.202150 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:46.203151 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:46.203954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:46.311482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8a0dc7d9004996b83774f2b4d897a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5188c6afe0f34319b4b787b96f720f3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:46.319463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d27bcb04-881e-4635-865f-8e7d3e14716f tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 200 len: 1510 microversion: 2.1 time: 0.136116 Nov 19 15:09:46.320044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 381/880] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:46 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 1510 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:09:46.324954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-fd184348-48df-415f-af67-43a6441fcb58 req-f50bcc90-3c48-444c-9f3e-99b863399430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d99f29-dbf8-45a9-8815-f96e0367bc65", "name": "network-vif-deleted", "tag": "d9cbc786-bc49-4094-b804-87076d431575"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:09:46.327511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:09:46.327511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:09:46.334640 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:46.336390 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fd184348-48df-415f-af67-43a6441fcb58 req-f50bcc90-3c48-444c-9f3e-99b863399430 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:46.336860 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fd184348-48df-415f-af67-43a6441fcb58 req-f50bcc90-3c48-444c-9f3e-99b863399430 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:46.345170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:46.347001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:46.348437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ab222ada-e9b2-4a2b-abc5-af93263c6ede tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.183692 Nov 19 15:09:46.349274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 500/881] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:46 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:09:46.349687 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-fd184348-48df-415f-af67-43a6441fcb58 req-f50bcc90-3c48-444c-9f3e-99b863399430 service nova] Creating event network-vif-deleted:d9cbc786-bc49-4094-b804-87076d431575 for instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 on hv-cinder-81757 Nov 19 15:09:46.362485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-fd184348-48df-415f-af67-43a6441fcb58 req-f50bcc90-3c48-444c-9f3e-99b863399430 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041074 Nov 19 15:09:46.363230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 382/882] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:09:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:09:47.338367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:47.338997 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] [instance: 14d99f29-dbf8-45a9-8815-f96e0367bc65] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:47.345338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:47.345782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:47.346552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:47.346982 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:47.360274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] HTTP exception thrown: Instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 could not be found. Nov 19 15:09:47.360863 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Returning 404 to user: Instance 14d99f29-dbf8-45a9-8815-f96e0367bc65 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:09:47.361658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-771aa9d1-698b-489f-aff1-a3dc6affaae2 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65" status: 404 len: 111 microversion: 2.1 time: 0.027248 Nov 19 15:09:47.362173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 501/883] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:09:47 2021] GET /compute/v2.1/servers/14d99f29-dbf8-45a9-8815-f96e0367bc65 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:09:47.368460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:47.369173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:47.369560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a5c01c50-1a4b-47dd-b4e7-dc618ca1ab13 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] Calling method '.version_select at 0x7f37c74e8af0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:47.375980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:47.376430 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:47.377235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:47.377668 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:47.388316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a5c01c50-1a4b-47dd-b4e7-dc618ca1ab13 tempest-TestMinimumBasicScenario-1038980881 tempest-TestMinimumBasicScenario-1038980881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-474767275" status: 202 len: 0 microversion: 2.1 time: 0.021979 Nov 19 15:09:47.388897 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 502/884] 10.222.0.20 () {58 vars in 1268 bytes} [Fri Nov 19 15:09:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-474767275 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:09:47.511294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:47.520730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:47.522337 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:47.523507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b40634c0-d5a4-49d8-8eb3-25b8e994ffaa tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.159557 Nov 19 15:09:47.524066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 383/885] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:47 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:09:48.543078 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:48.543689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:48.550896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:48.551352 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:48.552154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:48.552590 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:48.786053 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:48.793783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:48.796123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:48.797389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-83a1c79e-0e85-469d-9a66-8d71eb2502ea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.258460 Nov 19 15:09:48.797943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 503/886] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:48 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:49.816239 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:49.817664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:49.824614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:49.825105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:49.826129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:49.826656 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:49.962437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:49.971146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:49.972643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:49.973837 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82a4507f-3ca5-435b-a46a-28c92c48ff76 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.161382 Nov 19 15:09:49.974392 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 384/887] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:49 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:50.992921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:50.993815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:51.002877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:51.003430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:51.004393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:51.005098 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:51.221358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:51.236765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:51.238315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:51.239481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0f0c1e65-c737-4062-b689-8288d6c22817 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.250416 Nov 19 15:09:51.240037 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 504/888] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:50 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:52.258577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:52.259187 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:52.266366 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:52.266821 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:52.267611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:52.268304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:52.484783 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:52.492741 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:52.494306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:52.495465 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26f6a07a-00c5-4e7b-b4c4-eca086be972a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.240605 Nov 19 15:09:52.502593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 385/889] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:52 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:53.515403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:53.515403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:53.521647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:53.522101 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:53.522895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:53.523334 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:53.653697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:53.662186 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:53.663676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:53.664834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2ac3c13a-e856-4a5e-a048-b34c773aedf1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.154792 Nov 19 15:09:53.665382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 505/890] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:53 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:54.687337 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:54.687977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:54.694512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:54.695199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:54.698803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:54.699267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:54.873886 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:54.881550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:54.883024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:54.884200 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a4307a1-f9ee-4ed5-ac0e-29fe10be19d7 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.204751 Nov 19 15:09:54.895242 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 386/891] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:54 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:09:55.901908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:55.902630 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:55.909576 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:55.910026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:55.910846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:55.911283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:56.046929 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:56.057080 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:56.058589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:56.059748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-da3995b8-94f4-44be-a3a9-7b8b77a6b917 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.161484 Nov 19 15:09:56.060523 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 506/892] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:55 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:57.085168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:57.086642 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:57.094027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:57.094472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:57.095442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:57.096042 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:57.252267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:57.263749 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:57.265906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:57.267449 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-79d71486-47f4-4a8e-a3b9-645a754c8d0f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1745 microversion: 2.20 time: 0.187291 Nov 19 15:09:57.268546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 387/893] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:57 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:58.291867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:58.292500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:58.299811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:58.300513 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:58.301585 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:58.302189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:58.573441 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:58.583694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:58.585232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:58.586667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-82d7f6fc-a767-441b-a45a-a79fefa16522 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1745 microversion: 2.20 time: 0.298988 Nov 19 15:09:58.587224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 507/894] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:58 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:09:59.606553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:09:59.608574 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:09:59.618607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:59.619818 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:59.620863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:09:59.621487 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:09:59.833293 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:59.851584 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:59.853643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:09:59.856757 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-63678270-c642-4f21-8577-8103691e06c6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.253428 Nov 19 15:09:59.859440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 388/895] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:09:59 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:00.526922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-8f53ada9-e8c9-4513-b16a-a949ea38f229 req-0137a9eb-7d11-4154-b68f-d44742357427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "name": "network-vif-plugged", "status": "completed", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:00.528644 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:00.528644 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:00.546400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-8f53ada9-e8c9-4513-b16a-a949ea38f229 req-0137a9eb-7d11-4154-b68f-d44742357427 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:00.546854 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-8f53ada9-e8c9-4513-b16a-a949ea38f229 req-0137a9eb-7d11-4154-b68f-d44742357427 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:00.566329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-8f53ada9-e8c9-4513-b16a-a949ea38f229 req-0137a9eb-7d11-4154-b68f-d44742357427 service nova] Creating event network-vif-plugged:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:10:00.584322 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-8f53ada9-e8c9-4513-b16a-a949ea38f229 req-0137a9eb-7d11-4154-b68f-d44742357427 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220453 Nov 19 15:10:00.593373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 508/896] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:00.876729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:00.878008 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:00.885285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:00.889439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:00.890625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:00.894266 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:01.423889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:01.464679 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:01.466318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:01.470093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a3a4f071-d05b-4303-a11f-4a5e8aded678 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.594638 Nov 19 15:10:01.477233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 389/897] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:00 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:02.494151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:02.495492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:02.525741 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:02.526647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:02.530170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:02.530678 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:02.763946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:02.775099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:02.781109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:02.782720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3be7c28c-315e-4327-a2d0-52c0e8f8dc69 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.293464 Nov 19 15:10:02.783859 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 509/898] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:02 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:03.804906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:03.805568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:03.814805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:03.815470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:03.816358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:03.822699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:04.152330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:04.162448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:04.164071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:04.167639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c183fc8-ce01-4093-8d23-e7eab1277687 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.364383 Nov 19 15:10:04.168837 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 390/899] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:03 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:05.187013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:05.187628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:05.196241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:05.196691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:05.207220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:05.207917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:05.529430 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:05.540948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:05.547019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:05.551026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b867423c-2607-495c-81e4-319a499699a1 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.368287 Nov 19 15:10:05.552737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 510/900] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:05 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:06.570910 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:06.572260 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:06.585977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:06.588432 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:06.592980 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:06.593603 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:07.174546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:07.192523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:07.209001 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:07.210268 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3f5496fd-df4b-42fb-816b-d04631cccf84 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.643171 Nov 19 15:10:07.226036 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 391/901] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:06 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:08.248491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:08.249199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:08.260056 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:08.260345 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:08.261196 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:08.261638 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:08.560258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:08.577575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:08.580657 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:08.583133 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-418d6239-4b9d-4b67-84de-3005924f2eb4 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.343424 Nov 19 15:10:08.602840 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 511/902] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:08 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:08.908758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Action: 'create', calling method: .version_select at 0x7f37c758f160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1500830650"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:08.939038 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:08.953594 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for user 000d0cea98e84f78a913d6cf76136092 and project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:09.274087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:09.278319 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for user 000d0cea98e84f78a913d6cf76136092 and project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:09.296931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-80c0191f-bfc7-470d-8cf9-771fb7c18448 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.590374 Nov 19 15:10:09.297988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 392/903] 10.222.0.20 () {60 vars in 1157 bytes} [Fri Nov 19 15:10:08 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:09.604566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:09.605211 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:09.618715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:09.619159 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:09.621636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:09.623844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:09.796956 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:09.806687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:09.808465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:09.810782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-818be533-8efd-4cc0-9776-914b623f88dd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.211254 Nov 19 15:10:09.826763 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 512/904] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:09 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:10.829111 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:10.830567 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:10.851109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:10.851806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:10.853208 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:10.853758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:11.085281 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:11.095596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:11.101390 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:11.107613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a6eb49bb-d88f-48f2-bdbc-369fe8725fea tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.283131 Nov 19 15:10:11.108402 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 393/905] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:10 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:12.126284 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:12.127616 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:12.140809 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.141656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.144026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.145691 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.362624 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:12.364331 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:12.364564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:12.373486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:12.375689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:12.377096 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9cd30715-190c-449e-8e3b-6a56267710ad tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.255216 Nov 19 15:10:12.381383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.389765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.390963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.392459 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.393278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 513/906] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:12 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:12.464974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b8acc237-d232-4abe-a951-7852b294cde7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106274 Nov 19 15:10:12.468377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 394/907] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:10:12 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:10:12.557891 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:12.558668 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:12.566445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.567639 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.569323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.569973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.611903 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:10:12.806577 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ca1a9d07-1c41-420c-b20a-29174c07c6d9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 204 len: 0 microversion: 2.1 time: 0.251771 Nov 19 15:10:12.816602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:12.817648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:12.827269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 514/908] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:10:12 2021] DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:10:12.840889 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.841822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:12.842721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:12.843171 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:13.146568 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:13.157230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a55681df-3253-491b-bc11-ba4081c4a472 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1673 microversion: 2.1 time: 0.343888 Nov 19 15:10:13.158451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 395/909] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:12 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1673 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:13.397706 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:13.399128 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:13.415259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:13.415963 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:13.417089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:13.417533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:13.592772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:13.599563 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:13.601470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:13.602658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-990edf22-1204-4bbc-b640-1d70cc997f52 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1740 microversion: 2.20 time: 0.209290 Nov 19 15:10:13.603519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 515/910] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:13 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:14.175060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:14.175618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:14.181926 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:14.182407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:14.183189 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:14.183629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:14.317977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:14.326146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f15a0cef-9f99-44eb-bdf8-69a8de5505b2 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1673 microversion: 2.1 time: 0.153963 Nov 19 15:10:14.326877 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 396/911] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:14 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:14.621280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:14.621925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:14.628775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:14.629248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:14.630034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:14.630466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:14.777037 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:14.784694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:14.786215 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:14.787350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-12ce5ffd-bacc-4790-9665-dd012c6dfd2b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1722 microversion: 2.20 time: 0.169822 Nov 19 15:10:14.787901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 516/912] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:14 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:15.343582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:15.344286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:15.350582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:15.351037 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:15.351826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:15.352259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:15.591690 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:15.598900 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-29f11344-b693-4f2d-844f-c78bbe8c9d84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 200 len: 1673 microversion: 2.1 time: 0.259105 Nov 19 15:10:15.599477 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 397/913] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:15 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:15.811241 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:15.812434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:15.822016 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:15.822470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:15.823264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:15.823738 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:15.965974 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:15.973751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:15.975244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:15.976373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cbf9268e-5d72-49e3-8965-d4fef235b17a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1722 microversion: 2.20 time: 0.173943 Nov 19 15:10:15.976946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 517/914] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:15 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:16.098790 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-d7b18186-e9f9-4b2d-8e78-c84c8f1be1ea req-012c1787-4e4b-4318-9919-e3a2c50d78b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60727-6b69-40d5-81e4-79f73038581b", "name": "network-vif-deleted", "tag": "211e7156-2ffd-4fd3-879a-c68f83d6e874"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:16.101521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:16.101521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:10:16.111826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d7b18186-e9f9-4b2d-8e78-c84c8f1be1ea req-012c1787-4e4b-4318-9919-e3a2c50d78b2 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:16.112369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d7b18186-e9f9-4b2d-8e78-c84c8f1be1ea req-012c1787-4e4b-4318-9919-e3a2c50d78b2 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:16.125665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-d7b18186-e9f9-4b2d-8e78-c84c8f1be1ea req-012c1787-4e4b-4318-9919-e3a2c50d78b2 service nova] Creating event network-vif-deleted:211e7156-2ffd-4fd3-879a-c68f83d6e874 for instance 28d60727-6b69-40d5-81e4-79f73038581b on hv-cinder-81757 Nov 19 15:10:16.132216 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-d7b18186-e9f9-4b2d-8e78-c84c8f1be1ea req-012c1787-4e4b-4318-9919-e3a2c50d78b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Nov 19 15:10:16.132842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 398/915] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:16.620345 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:16.621151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:16.628161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:16.628611 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:16.629464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:16.629906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:16.643824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. Nov 19 15:10:16.644428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:10:16.645309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-23644cd9-d1e0-4034-bea2-09a260f3b370 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 404 len: 111 microversion: 2.1 time: 0.031485 Nov 19 15:10:16.645842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 518/916] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:16 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:10:16.654559 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a9c179b-9b8d-4d1b-b61b-3868538505b1 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '.version_select at 0x7f37c73eaca0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:16.672894 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a9c179b-9b8d-4d1b-b61b-3868538505b1 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024069480" status: 202 len: 0 microversion: 2.1 time: 0.022286 Nov 19 15:10:16.673700 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 399/917] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Nov 19 15:10:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024069480 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:10:16.995627 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:16.997710 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:17.005897 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.006406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.017923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.018593 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.249917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:17.257712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:17.259294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:17.261384 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0ab25c0b-1239-4914-8af8-df182c62c3f2 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1725 microversion: 2.20 time: 0.270279 Nov 19 15:10:17.275395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 519/918] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:16 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:10:17.282830 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bcb7ecf-91be-40f3-9ed6-bdb85a881f52"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:17.284023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:17.290541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.290995 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.291782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.292228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.462510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: .version_select at 0x7f37c74a4940>, body: {"keypair": {"name": "tempest-keypair-1777279953"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:17.476252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:17.480407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:17.599292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f21d7b0b-d26a-4eb7-b875-2792b2db307a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322088 Nov 19 15:10:17.599896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 400/919] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Nov 19 15:10:17 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:17.650940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:17.654871 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'key_pairs'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:17.667274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-070444ef-cdd4-4a09-9c68-3e2ad4c848f5 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.208893 Nov 19 15:10:17.668038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 520/920] 10.222.0.20 () {60 vars in 1157 bytes} [Fri Nov 19 15:10:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:17.712717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:17.713927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:17.721674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.722128 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.722930 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:17.723365 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:17.993452 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd448dca-9737-4041-9c33-849920d486cd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments/0bcb7ecf-91be-40f3-9ed6-bdb85a881f52" status: 202 len: 0 microversion: 2.20 time: 0.285173 Nov 19 15:10:17.998149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 401/921] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Nov 19 15:10:17 2021] DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments/0bcb7ecf-91be-40f3-9ed6-bdb85a881f52 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:10:18.045208 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-d6bd4791-202c-4577-9ab4-de2db87d5ffd req-786b8ac9-b062-4a67-b771-b2cef5cac41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "name": "network-vif-unplugged", "status": "completed", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:18.051167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:18.051167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:18.061482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:18.062067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:18.067289 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d6bd4791-202c-4577-9ab4-de2db87d5ffd req-786b8ac9-b062-4a67-b771-b2cef5cac41a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:18.067660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-d6bd4791-202c-4577-9ab4-de2db87d5ffd req-786b8ac9-b062-4a67-b771-b2cef5cac41a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:18.071758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:18.073276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:18.074622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:18.075842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:18.082875 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.compute.server_external_events [req-d6bd4791-202c-4577-9ab4-de2db87d5ffd req-786b8ac9-b062-4a67-b771-b2cef5cac41a service nova] Unable to find a host for instance ba17f361-87f8-4374-aa75-1a438c25b99f. Dropping event network-vif-unplugged {{(pid=116265) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 15:10:18.084678 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-d6bd4791-202c-4577-9ab4-de2db87d5ffd req-786b8ac9-b062-4a67-b771-b2cef5cac41a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049057 Nov 19 15:10:18.086048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 521/922] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 19 15:10:18.158185 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ded5331b-7d49-4678-a7a7-b1b9458460bc tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action" status: 202 len: 0 microversion: 2.20 time: 0.108284 Nov 19 15:10:18.158795 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 402/923] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Nov 19 15:10:18 2021] POST /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:10:18.166549 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:18.167396 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:18.173386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:18.173842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:18.175076 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:18.175734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:18.421205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:18.428818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:18.430341 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:18.431478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9a4dd6e4-5059-4e09-b849-02aff1766e2e tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1673 microversion: 2.20 time: 0.268643 Nov 19 15:10:18.432026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 522/924] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:18 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:19.321576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1197952534", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed0406b4-0bfe-439f-b48b-c510341d69dd"}], "security_groups": [{"name": "tempest-securitygroup--356095878"}], "key_name": "tempest-keypair-1777279953", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:19.425051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] validate_networks() for [('ed0406b4-0bfe-439f-b48b-c510341d69dd', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:10:19.450635 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:19.451619 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:19.458335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:19.458791 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:19.459592 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:19.460033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:19.629694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:19.646755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:19.648405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:19.664860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e7da6fbe-8e59-4657-a360-54d6533dde7b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1673 microversion: 2.20 time: 0.203408 Nov 19 15:10:19.664860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 523/925] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:19 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:10:19.933651 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:10:19.934150 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:10:19.935202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:10:19.935638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:10:19.936055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:10:19.944884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:19.945337 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:19.946165 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:19.946608 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:19.962836 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for project a0e2bcec34734e86900951518afe4cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:19.967403 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Getting quotas for user f36e6f35a5e944429f0e1779651c807d and project a0e2bcec34734e86900951518afe4cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:19.977928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:10:19.980262 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:10:20.026566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ea2e45a-ba44-45d2-ad48-f32d875c72c4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.709258 Nov 19 15:10:20.027393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 403/926] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:10:19 2021] POST /compute/v2.1/servers => generated 401 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:10:20.037595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8e5d026e-c6b9-4a5c-a772-5b7156855c14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:20.038207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8e5d026e-c6b9-4a5c-a772-5b7156855c14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:20.092046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8e5d026e-c6b9-4a5c-a772-5b7156855c14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:20.098531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8e5d026e-c6b9-4a5c-a772-5b7156855c14 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1238 microversion: 2.1 time: 0.064534 Nov 19 15:10:20.099098 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 524/927] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:20 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:20.670046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:20.670685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:20.677080 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:20.678310 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:20.679279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:20.679719 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:20.830421 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:20.838541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:20.840116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:20.841842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b5fff5f-c068-4220-81de-790d7987fc03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1673 microversion: 2.20 time: 0.176707 Nov 19 15:10:20.842401 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 404/928] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:20 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:21.115480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:21.116233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:21.123560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:21.124742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:21.125798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:21.126415 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:21.191099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:21.198775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-09826d0f-2bfd-4c8a-bfbe-f6a897228f98 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1296 microversion: 2.1 time: 0.087165 Nov 19 15:10:21.199383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 525/929] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:21 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:21.861485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:21.862721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:21.869928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:21.871135 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:21.872253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:21.872966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:22.116981 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:22.125518 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:22.127287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:22.128447 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1298ea2f-2308-477f-9f3f-09b2b22d5c82 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1673 microversion: 2.20 time: 0.272105 Nov 19 15:10:22.129041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 405/930] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:21 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:10:22.218043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:22.218642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:22.224928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:22.225379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:22.226164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:22.226601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:22.355271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:22.362958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f97dccd7-a339-4396-835c-2b9993d122fc tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.149837 Nov 19 15:10:22.363720 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 526/931] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:22 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:22.643807 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-f190b0f3-e385-46dd-8769-eab2c287201d req-0c5f5135-25fe-4806-b998-74eac2cc702a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b51e89-d3f8-4801-bb3d-c022acdb340c", "tag": "81381387-9554-484f-96f4-ccedc01e4bd8"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:22.646068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:22.646068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:10:22.656074 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f190b0f3-e385-46dd-8769-eab2c287201d req-0c5f5135-25fe-4806-b998-74eac2cc702a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:22.657033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f190b0f3-e385-46dd-8769-eab2c287201d req-0c5f5135-25fe-4806-b998-74eac2cc702a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:22.671793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-f190b0f3-e385-46dd-8769-eab2c287201d req-0c5f5135-25fe-4806-b998-74eac2cc702a service nova] Creating event network-changed:81381387-9554-484f-96f4-ccedc01e4bd8 for instance 31b51e89-d3f8-4801-bb3d-c022acdb340c on hv-cinder-81757 Nov 19 15:10:22.677411 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-f190b0f3-e385-46dd-8769-eab2c287201d req-0c5f5135-25fe-4806-b998-74eac2cc702a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038639 Nov 19 15:10:22.678182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 406/932] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:23.147554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:23.148495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:23.155949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:23.156480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:23.157374 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:23.158023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:23.302468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:23.311733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:23.313357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:23.314603 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-28de370a-fa9a-47db-9207-d998651cf8f0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1673 microversion: 2.20 time: 0.171607 Nov 19 15:10:23.315335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 527/933] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:23 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:23.381394 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:23.382196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:23.389696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:23.390230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:23.391026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:23.391468 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:23.616405 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:23.625973 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-53996070-267d-4ad2-bd3e-a741a212ed0d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.248265 Nov 19 15:10:23.626913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 407/934] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:23 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:24.332897 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:24.333556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:24.339945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:24.341058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:24.341896 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:24.342327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:24.476239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:24.484918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:24.485604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:24.486746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-eacbf815-c0a2-4d18-8bd9-f1942115e4a5 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.157583 Nov 19 15:10:24.487301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 528/935] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:24 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:24.648648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:24.649277 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:24.656122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:24.656688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:24.657607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:24.658053 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:24.797181 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:24.804439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4cd12a26-e5d0-49ef-9e1b-bd72bd58c159 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.159865 Nov 19 15:10:24.805046 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 408/936] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:24 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:25.505599 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:25.506181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:25.513021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:25.513567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:25.514411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:25.515011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:25.656047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:25.664512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:25.666040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:25.667220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-691fce04-60ff-44dd-a12f-3dc724328300 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.165375 Nov 19 15:10:25.667780 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 529/937] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:25 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:25.823013 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:25.823619 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:25.830582 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:25.831033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:25.831815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:25.832247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:25.983634 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:25.992109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56ff996f-d4cb-431f-a81f-9d4d79e03b7e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.172291 Nov 19 15:10:25.996841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 409/938] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:25 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:26.686612 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:26.687141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:26.693493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:26.693941 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:26.694729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:26.695157 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:26.829954 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:26.847317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:26.848879 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:26.850047 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2634644d-2dfb-4fff-8acd-dfa0e2383c27 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.167834 Nov 19 15:10:26.850623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 530/939] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:26 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:27.010610 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:27.012374 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:27.018999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:27.019751 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:27.020696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:27.021190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:27.164407 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:27.173195 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6e720e7f-31ed-41be-8d05-6d4bd1b243cd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.167226 Nov 19 15:10:27.176127 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 410/940] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:27 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:27.873301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:27.873966 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:27.879893 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:27.880336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:27.881146 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:27.881574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:28.035839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:28.044423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:28.046380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:28.048017 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a5f787a2-0353-4954-955f-a61e109c8396 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.179505 Nov 19 15:10:28.049212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 531/941] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:27 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:28.155660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-bce58b3e-6ce9-409d-834e-06a471c88020 req-fa3b31ac-d7fe-40ee-a57e-38550e97a42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b51e89-d3f8-4801-bb3d-c022acdb340c", "name": "network-vif-plugged", "status": "completed", "tag": "81381387-9554-484f-96f4-ccedc01e4bd8"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:28.157570 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:28.157570 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:10:28.167193 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-bce58b3e-6ce9-409d-834e-06a471c88020 req-fa3b31ac-d7fe-40ee-a57e-38550e97a42d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:28.167671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-bce58b3e-6ce9-409d-834e-06a471c88020 req-fa3b31ac-d7fe-40ee-a57e-38550e97a42d service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:28.179186 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-bce58b3e-6ce9-409d-834e-06a471c88020 req-fa3b31ac-d7fe-40ee-a57e-38550e97a42d service nova] Creating event network-vif-plugged:81381387-9554-484f-96f4-ccedc01e4bd8 for instance 31b51e89-d3f8-4801-bb3d-c022acdb340c on hv-cinder-81757 Nov 19 15:10:28.185112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-bce58b3e-6ce9-409d-834e-06a471c88020 req-fa3b31ac-d7fe-40ee-a57e-38550e97a42d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Nov 19 15:10:28.186235 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 411/942] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:28.191442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:28.192191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:28.206906 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:28.208305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:28.210139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:28.210869 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:28.357945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:28.365699 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-292af441-7ad2-4afd-9422-8e66a445209b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.178443 Nov 19 15:10:28.366293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 532/943] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:28 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:29.068184 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:29.068918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:29.075822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.076297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.078844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.079304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.138919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1912516718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1500830650", "security_groups": [{"name": "tempest-secgroup-smoke-556241559"}], "networks": [{"uuid": "0559b452-5fe2-4232-b5a3-a5ef8698cc01"}], "block_device_mapping_v2": [{"uuid": "d099e8e3-ede5-4721-a95d-9267ba8119d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:29.225867 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:29.234727 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:29.236593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:29.237896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-24d3cc7c-81d8-4f1e-952b-6678b08ed214 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.173825 Nov 19 15:10:29.238526 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 412/944] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:29 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:29.262790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] validate_networks() for [('0559b452-5fe2-4232-b5a3-a5ef8698cc01', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:10:29.382469 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:29.383280 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:29.390122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.390928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.391969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.392632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.553820 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:29.562016 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1913ca99-c442-4f6a-8cce-075853f19dc6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.183072 Nov 19 15:10:29.562688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 413/945] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:29 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:29.721693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:10:29.722192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:10:29.722811 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:10:29.723293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:10:29.723791 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:10:29.734373 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.734813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.735658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:29.736095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:29.760346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:10:29.764663 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Getting quotas for user 000d0cea98e84f78a913d6cf76136092 and project 25b1a546d19f4c95ac7e9af520d72381. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:10:29.821437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:10:29.823560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d099e8e3-ede5-4721-a95d-9267ba8119d4',volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:10:29.955617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b182f1d1-e522-4348-967e-0629eb712de1 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820653 Nov 19 15:10:29.956923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 533/946] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:10:29 2021] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 15:10:29.971296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-264fea0f-84da-4c87-b3f2-52d6ca55c175 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:29.972040 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-264fea0f-84da-4c87-b3f2-52d6ca55c175 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:30.030968 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-264fea0f-84da-4c87-b3f2-52d6ca55c175 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:30.037710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-264fea0f-84da-4c87-b3f2-52d6ca55c175 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1089 microversion: 2.1 time: 0.073728 Nov 19 15:10:30.038903 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 414/947] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:29 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:30.256259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:30.257044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:30.268008 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:30.268904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:30.269704 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:30.270143 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:30.420239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:30.428817 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:30.430245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:30.431574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1521dd0c-4374-4e7a-aefa-9e4abe78ea16 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.179539 Nov 19 15:10:30.432363 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 534/948] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:30 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:30.579372 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:30.579978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:30.586872 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:30.587678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:30.588473 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:30.588928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:30.728966 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:30.737581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6553299d-c928-4518-a926-2baa7dbad2d4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.161924 Nov 19 15:10:30.738162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 415/949] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:30 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:31.055361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:31.055886 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:31.061888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.062337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.063118 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.063552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.128334 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:31.135862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a6ecfc85-ce96-4c82-83fc-f29d3c370688 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1139 microversion: 2.1 time: 0.084212 Nov 19 15:10:31.136437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 535/950] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:31 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:31.451689 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:31.452290 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:31.458764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.459230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.460106 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.460740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.600711 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:31.610506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:31.612003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:31.613491 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f54bfc01-1e13-4e08-9cde-54b0d746f5ff tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.166376 Nov 19 15:10:31.614045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 416/951] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:31 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:31.754386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:31.756074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:31.761535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.762365 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.763039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:31.763544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:31.909191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:31.916723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c064e81e-f8a6-4604-a4c0-9c9eb09da0dd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.165979 Nov 19 15:10:31.917338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 536/952] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:31 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:32.154125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:32.154768 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:32.161065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.161520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:32.162313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.162794 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:32.225383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:32.233291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-27953802-757a-4867-b04a-677addbf1553 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1139 microversion: 2.1 time: 0.083541 Nov 19 15:10:32.233857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 417/953] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:32 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:32.633185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:32.633796 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:32.640501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.640978 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:32.641763 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.642191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:32.779846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:32.788112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:32.789726 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:32.790949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-88fba596-a9bb-4bfb-9a3f-d72567e4222a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.161503 Nov 19 15:10:32.791750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 537/954] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:32 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:32.989073 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:32.989775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:32.995908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.996996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:32.998011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:32.998523 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:33.140940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:33.148515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-289b7a1d-ab8e-4fd5-b312-178bb4da6dc9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.218526 Nov 19 15:10:33.149122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 418/955] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:32 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:33.249814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:33.250335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:33.256454 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:33.256931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:33.257719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:33.258178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:33.320985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:33.328527 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-78ba1239-979d-4afa-b376-60e8aba814ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1139 microversion: 2.1 time: 0.082904 Nov 19 15:10:33.329316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 538/956] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:33 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:33.809269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:33.809878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:33.815916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:33.816368 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:33.817184 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:33.817626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:33.954820 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:33.962961 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:33.964436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:33.966291 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e8731f1e-884d-46a9-acb8-16f39460da7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.160953 Nov 19 15:10:33.966851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 419/957] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:33 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:34.165289 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:34.165938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:34.172427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.172913 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:34.173822 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.174327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:34.313676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:34.321470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1d565319-fe5b-48e7-868c-5e0c9ae3794a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.159947 Nov 19 15:10:34.322147 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 539/958] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:34 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:34.345739 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:34.346345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:34.352410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.352901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:34.353704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.354146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:34.416539 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:34.425081 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-552c4e4d-2657-4c15-9a34-11c229ba1d8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1139 microversion: 2.1 time: 0.083007 Nov 19 15:10:34.425653 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 420/959] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:34 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:34.985102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:34.985620 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:34.991432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.991875 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:34.992673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:34.993122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:35.120486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:35.128250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:35.129773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:35.130917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-65070871-4e73-4074-b12a-02da96c8057a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.150211 Nov 19 15:10:35.131476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 540/960] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:34 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:35.339649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:35.340371 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:35.347408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:35.348019 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:35.348639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:35.349105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:35.441733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:35.442340 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:35.448696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:35.449192 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:35.450652 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:35.451085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:35.515440 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:35.523622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e525853e-99ce-482d-aa3e-225d117448e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.187738 Nov 19 15:10:35.524263 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 421/961] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:35 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:35.546197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:35.553496 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-37feb6dd-ea72-4977-abc8-4510aee4c642 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1131 microversion: 2.1 time: 0.115224 Nov 19 15:10:35.554236 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 541/962] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:35 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1131 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:36.149645 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:36.150685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:36.157168 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.157695 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.158553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.159593 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.389543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:36.398092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:36.399581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:36.400836 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2c29a5b2-b007-4bc2-850e-d593cf937e03 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.255856 Nov 19 15:10:36.401357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 422/963] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:36 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:36.542389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:36.543625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:36.552463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.552463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.553297 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.553737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.571501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:36.572115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:36.579614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.580062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.580880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:36.581313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:36.705398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:36.713458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61e1c88c-3b72-41dc-8c1c-06c6b86d5850 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1205 microversion: 2.1 time: 0.145825 Nov 19 15:10:36.715683 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 423/964] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:36 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1205 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:36.728167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:36.736884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-31ae3bc8-57f6-4eeb-b6fc-8285a971b726 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1363 microversion: 2.1 time: 0.198785 Nov 19 15:10:36.737723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 542/965] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:36 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:37.420327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:37.421034 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:37.427846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.428361 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.429271 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.429771 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.602945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-9ca640d3-99a6-445c-b5dc-ef7c02f4ba30 req-bc45aa38-6d26-47e6-b157-30a57dce8094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:37.606932 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:37.606932 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:37.615775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9ca640d3-99a6-445c-b5dc-ef7c02f4ba30 req-bc45aa38-6d26-47e6-b157-30a57dce8094 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.616223 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9ca640d3-99a6-445c-b5dc-ef7c02f4ba30 req-bc45aa38-6d26-47e6-b157-30a57dce8094 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.634309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-9ca640d3-99a6-445c-b5dc-ef7c02f4ba30 req-bc45aa38-6d26-47e6-b157-30a57dce8094 service nova] Creating event network-changed:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:10:37.641301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-9ca640d3-99a6-445c-b5dc-ef7c02f4ba30 req-bc45aa38-6d26-47e6-b157-30a57dce8094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041227 Nov 19 15:10:37.642318 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 543/966] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:37.645460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:37.657899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:37.659735 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:37.660925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-786e211c-f348-4f2f-86b2-d51d12c114b0 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.245758 Nov 19 15:10:37.661556 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 424/967] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:37 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:37.732546 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:37.733283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:37.739921 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.740375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.741228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.741843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.753321 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:37.754426 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:37.760387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.760853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.761639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:37.763105 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:37.882761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:37.890578 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0aa7c6ec-e933-40b8-b55d-59011974ed9a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.162220 Nov 19 15:10:37.891149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 544/968] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:37 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:37.976540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:37.983840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-22117b01-7754-417b-a1cc-0b9bf0c0b498 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1549 microversion: 2.1 time: 0.234332 Nov 19 15:10:37.984410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 425/969] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:37 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:38.000723 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:38.001268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:38.007952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.008491 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:38.009305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.009742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:38.101172 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4112c250-8c8b-4232-b638-5985752a843a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104944 Nov 19 15:10:38.101766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 545/970] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Nov 19 15:10:37 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:38.679094 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:38.679692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:38.686803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.687256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:38.688044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.688484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:38.908264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:38.908884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:38.914661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.915107 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:38.915875 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:38.916303 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:39.048243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:39.056464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9936b2eb-47c9-4ad2-9086-73ac03f2d9e7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.152303 Nov 19 15:10:39.057055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 546/971] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:38 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:39.071202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:39.079813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:39.081327 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:39.082482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4ba5f556-1c25-4c47-8094-ce133d1f9895 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.407075 Nov 19 15:10:39.083243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 426/972] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:38 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:39.762002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:39.763202 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:39.764856 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-49657d98-2360-4587-9d91-58892eb5e62c req-088026dc-5722-4ec8-87f3-1dc871aba68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b51e89-d3f8-4801-bb3d-c022acdb340c", "tag": "81381387-9554-484f-96f4-ccedc01e4bd8"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:39.766553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:39.766553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:10:39.769936 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:39.770633 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:39.771448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:39.771922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:39.774302 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-49657d98-2360-4587-9d91-58892eb5e62c req-088026dc-5722-4ec8-87f3-1dc871aba68c service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:39.775467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-49657d98-2360-4587-9d91-58892eb5e62c req-088026dc-5722-4ec8-87f3-1dc871aba68c service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:39.787263 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-49657d98-2360-4587-9d91-58892eb5e62c req-088026dc-5722-4ec8-87f3-1dc871aba68c service nova] Creating event network-changed:81381387-9554-484f-96f4-ccedc01e4bd8 for instance 31b51e89-d3f8-4801-bb3d-c022acdb340c on hv-cinder-81757 Nov 19 15:10:39.792353 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-49657d98-2360-4587-9d91-58892eb5e62c req-088026dc-5722-4ec8-87f3-1dc871aba68c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Nov 19 15:10:39.793222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 427/973] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:39.836088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-aa36b4e8-cec5-4167-9bf1-7d908031609e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.077597 Nov 19 15:10:39.836895 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 547/974] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:39 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:40.074176 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:40.075468 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:40.081753 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.082211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.083197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.083632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.102389 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:40.103925 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:40.114156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.115011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.117126 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.117806 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.274447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:40.284927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:40.287410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:40.288913 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-71266dc1-c575-427a-8eb7-dcbb22526567 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.191479 Nov 19 15:10:40.300019 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:40.300371 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa1e83e8-8b5a-49f7-a07c-8ba2a624113a tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.230187 Nov 19 15:10:40.301334 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 548/975] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:40 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:10:40.309789 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 428/976] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:40 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:40.498539 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-a5951bb1-0215-4613-a98b-c459f6dc3295 req-7571ab9e-a40a-48a6-80a3-203d1d03b6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "name": "network-vif-plugged", "status": "completed", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:40.500068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:40.500068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:40.507627 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-a5951bb1-0215-4613-a98b-c459f6dc3295 req-7571ab9e-a40a-48a6-80a3-203d1d03b6f5 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.508529 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-a5951bb1-0215-4613-a98b-c459f6dc3295 req-7571ab9e-a40a-48a6-80a3-203d1d03b6f5 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.521034 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-a5951bb1-0215-4613-a98b-c459f6dc3295 req-7571ab9e-a40a-48a6-80a3-203d1d03b6f5 service nova] Creating event network-vif-plugged:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:10:40.525928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-a5951bb1-0215-4613-a98b-c459f6dc3295 req-7571ab9e-a40a-48a6-80a3-203d1d03b6f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Nov 19 15:10:40.526531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 549/977] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:40.846579 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:40.847669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:40.853963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.854418 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.855203 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:40.856155 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:40.981791 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-18b042a7-c3a1-4283-9dfd-303d4b0e430a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.137964 Nov 19 15:10:40.982849 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 429/978] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:40 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:41.308477 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:41.309268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:41.315369 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:41.315818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:41.316528 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:41.316662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:41.317074 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:41.317256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:41.323979 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:41.324974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:41.326182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:41.326629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:41.448243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:41.456638 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:41.458173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:41.459308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-49406721-5261-47d3-a59e-1412f79b23bd tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.155431 Nov 19 15:10:41.460292 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 550/979] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:41 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:41.468614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:41.475803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-738911af-65fd-4bc5-b916-bd0dfa1c3bc8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.163258 Nov 19 15:10:41.476348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 430/980] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:41 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:41.992558 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:41.993658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:42.000552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.001069 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.001861 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.002298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.066497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e5cdb378-da0c-4445-8cf9-f0d4eaec2b24 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.077571 Nov 19 15:10:42.067816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 551/981] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:41 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:42.477314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:42.477926 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:42.485060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.485511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.486289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.486728 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.492509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:42.493239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:42.501446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.501904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.502700 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:42.503145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:42.649969 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:42.650713 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:42.658766 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:42.659137 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0473bd1c-9d31-489c-a107-acb59c5e9fc9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.170651 Nov 19 15:10:42.659708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 552/982] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:42 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:42.660269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:42.661581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e1f2afed-0fb6-4852-9c12-20e2fb665430 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1731 microversion: 2.20 time: 0.187983 Nov 19 15:10:42.662163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 431/983] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:42 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:10:43.077819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:43.078744 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:43.085263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.085716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.086493 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.086930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.145636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d38ca34c-ef38-4e1c-bd94-0013cebfe1f9 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.071946 Nov 19 15:10:43.146400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 553/984] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:43 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:43.676782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:43.677417 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:43.680439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:43.681169 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:43.683677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.684123 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.684928 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.685360 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.688132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.688573 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.689374 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:43.689807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:43.821084 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:43.822670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:43.829466 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9306f05-5958-4b62-aa58-022c96765663 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.156448 Nov 19 15:10:43.830048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 432/985] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:43 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:43.831083 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:43.832562 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:43.833725 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-383ae083-fa20-48d4-98ef-d1cfe3c6998b tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1718 microversion: 2.20 time: 0.157264 Nov 19 15:10:43.834262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 554/986] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:10:43 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:10:44.156557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:44.157596 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:44.163436 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:44.163882 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:44.164646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:44.165127 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:44.223422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9880808-2eba-413c-ba4a-cd7beee2ba84 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.070562 Nov 19 15:10:44.224023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 433/987] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:44 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:10:44.846845 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:44.847451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:44.853749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:44.854199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:44.854973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:44.855435 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:44.985689 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:44.992837 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-75500127-ac01-4b45-8774-c33274489e66 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.149699 Nov 19 15:10:44.993410 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 555/988] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:44 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:45.235027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:45.236017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:45.242863 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:45.243307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:45.244077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:45.244529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:45.303318 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc9b1f07-1489-4952-9e87-32bcb9852993 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.072494 Nov 19 15:10:45.303913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 434/989] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:45 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 15:10:46.009865 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:46.010424 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:46.016656 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:46.017132 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:46.017942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:46.018376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:46.154447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:46.161742 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c35594dc-cb7e-458f-b1df-e6ff5fde9bf5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.155580 Nov 19 15:10:46.162380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 556/990] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:46 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:46.315477 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:46.316512 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:46.323450 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:46.323898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:46.325455 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:46.325793 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:46.385641 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-86099946-c8b7-4c0c-839a-52d01ecffcbe tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.074092 Nov 19 15:10:46.386262 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 435/991] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:46 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:47.179084 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:47.179687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:47.186035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:47.186475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:47.187240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:47.187665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:47.317484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:47.325705 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-97a9bcd5-284b-4e03-a396-1329b9c370c0 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.149876 Nov 19 15:10:47.326266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 557/992] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:47 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:47.397578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:47.398580 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:47.406028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:47.406485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:47.407265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:47.407706 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:47.469303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8a262d97-cd7f-48c1-972e-9bc05dc0d35f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.075522 Nov 19 15:10:47.469822 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 436/993] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:47 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:48.233795 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-2fba7625-75d4-49cb-b02f-00526a865886 req-31ee16e9-7627-4c8e-ae66-f8124ff35001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "name": "network-vif-plugged", "status": "completed", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:48.236068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:48.236068 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:48.244235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-2fba7625-75d4-49cb-b02f-00526a865886 req-31ee16e9-7627-4c8e-ae66-f8124ff35001 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:48.244697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-2fba7625-75d4-49cb-b02f-00526a865886 req-31ee16e9-7627-4c8e-ae66-f8124ff35001 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:48.255770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-2fba7625-75d4-49cb-b02f-00526a865886 req-31ee16e9-7627-4c8e-ae66-f8124ff35001 service nova] Creating event network-vif-plugged:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:10:48.260641 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-2fba7625-75d4-49cb-b02f-00526a865886 req-31ee16e9-7627-4c8e-ae66-f8124ff35001 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Nov 19 15:10:48.261460 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 558/994] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:48.343072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:48.343764 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:48.350555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:48.350998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:48.351770 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:48.352200 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:48.480606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:48.481621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:48.487805 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:48.488247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:48.489055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:48.489489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:48.515257 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:48.523619 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed8d0816-1506-4e24-811e-bea5b24fab15 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.185279 Nov 19 15:10:48.524550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 437/995] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:48 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:48.548693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-81d5454c-b5c2-4ceb-a56e-36612537edcd tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 14 microversion: 2.1 time: 0.071944 Nov 19 15:10:48.549535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 559/996] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:48 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:10:49.540548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:49.541187 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:49.548015 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:49.548464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:49.549276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:49.549711 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:49.560155 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:49.561183 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:49.568392 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:49.568864 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:49.569776 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:49.570380 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:49.662464 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cffea80b-c601-4575-b36b-41f40cc53634 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 10235 microversion: 2.1 time: 0.105746 Nov 19 15:10:49.666256 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 560/997] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:49 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 10235 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:10:49.689800 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:49.698370 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c1a4aca-cae9-4a23-815c-a7e911b1c829 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1260 microversion: 2.1 time: 0.161473 Nov 19 15:10:49.698940 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 438/998] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:49 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:50.675398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:50.676631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:50.683731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.684772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:50.685583 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.686045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:50.716762 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:50.717489 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:50.723667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.724117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:50.724922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.725353 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:50.765483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-134c794d-c6dd-47a4-9f0c-1921cb1bd8ad tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 17602 microversion: 2.1 time: 0.094305 Nov 19 15:10:50.766248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 561/999] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:50 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 17602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:50.860819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:50.868119 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1235624-3096-498d-abdc-9fdd420f0c84 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1445 microversion: 2.1 time: 0.156382 Nov 19 15:10:50.868698 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 439/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:50 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:10:50.884377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:10:50.885115 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:50.892082 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.892533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:50.893329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:50.893766 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:51.023021 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:10:51.031237 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d66fcee2-9cd1-487e-8865-800e216fdf24 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1445 microversion: 2.1 time: 0.150880 Nov 19 15:10:51.031788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 562/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:10:50 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:10:51.776960 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:51.777905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:51.784108 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:51.784571 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:51.785355 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:51.785787 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:51.860901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5919c338-46b3-45b4-8fd7-08de5c7d6d7b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 18449 microversion: 2.1 time: 0.087494 Nov 19 15:10:51.862359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 440/1002] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:51 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 18449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:52.643201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-bc5fa7df-b313-4e8a-9815-8ff72db462d9 req-6a86e7cf-b958-4dd0-8c69-febef880a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:52.644693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:10:52.644693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:10:52.651819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-bc5fa7df-b313-4e8a-9815-8ff72db462d9 req-6a86e7cf-b958-4dd0-8c69-febef880a505 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:52.652258 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-bc5fa7df-b313-4e8a-9815-8ff72db462d9 req-6a86e7cf-b958-4dd0-8c69-febef880a505 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:52.662984 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-bc5fa7df-b313-4e8a-9815-8ff72db462d9 req-6a86e7cf-b958-4dd0-8c69-febef880a505 service nova] Creating event network-changed:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:10:52.667815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-bc5fa7df-b313-4e8a-9815-8ff72db462d9 req-6a86e7cf-b958-4dd0-8c69-febef880a505 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028250 Nov 19 15:10:52.669318 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 563/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:10:52.875032 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:52.876149 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:52.884045 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:52.884497 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:52.885805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:52.886272 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:52.961173 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-01952a41-fea8-4e2f-b1bc-d406acfd7b50 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 21110 microversion: 2.1 time: 0.092147 Nov 19 15:10:52.962383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 441/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:52 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 21110 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:53.973372 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:53.974281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:53.980784 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:53.981263 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:53.982033 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:53.982460 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:54.060574 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a0c3b598-5347-482e-8fd9-9d1b71f9c6ee tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 22981 microversion: 2.1 time: 0.091185 Nov 19 15:10:54.061228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 564/1005] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:53 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 22981 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:55.072522 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:55.073564 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:55.080649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:55.081134 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:55.081922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:55.082364 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:55.169251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0eb2ddd4-2f04-4b85-bae5-f71a7def809e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 24096 microversion: 2.1 time: 0.100056 Nov 19 15:10:55.169880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 442/1006] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:55 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 24096 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:56.180460 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:56.181474 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:56.189065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:56.189516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:56.190296 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:56.190731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:56.266867 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5b27bd98-d0f4-48ea-8a12-7b0a383fa076 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 25619 microversion: 2.1 time: 0.090241 Nov 19 15:10:56.267478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 565/1007] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:56 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 25619 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:57.279918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:57.280958 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:57.287633 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:57.288082 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:57.288916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:57.289340 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:57.379127 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7478c5ae-1447-482c-a7b3-97d8ef3207ba tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 26825 microversion: 2.1 time: 0.104108 Nov 19 15:10:57.380048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 443/1008] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:57 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 26825 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:58.391216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:58.392253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:58.398993 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:58.399434 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:58.400203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:58.400632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:58.486774 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a84aa934-f653-45eb-97af-0c6660665630 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 27525 microversion: 2.1 time: 0.099444 Nov 19 15:10:58.487301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 566/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:58 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 27525 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:10:59.498987 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:10:59.499984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:10:59.506737 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:59.507183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:59.507959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:10:59.508393 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:10:59.587147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93ea7db8-b91c-4d38-9676-c5e75f6f1554 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 27904 microversion: 2.1 time: 0.092035 Nov 19 15:10:59.587805 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 444/1010] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:10:59 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 27904 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:00.599791 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:00.600807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:00.608278 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:00.608703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:00.609503 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:00.609947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:00.688891 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-74548ba8-c187-43de-ad48-9492d0074492 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28198 microversion: 2.1 time: 0.093032 Nov 19 15:11:00.689497 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 567/1011] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:00 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:01.699892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:01.700922 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:01.707702 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:01.708151 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:01.708959 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:01.709400 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:01.777914 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a74a015-5b25-4b4e-8855-a93ba365bb6c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28198 microversion: 2.1 time: 0.081899 Nov 19 15:11:01.778647 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 445/1012] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:01 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:02.790029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:02.791040 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:02.798678 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:02.799217 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:02.800379 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:02.800861 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:02.891748 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-df99c95a-2b12-40ce-9f86-5a4a7dd8af42 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28488 microversion: 2.1 time: 0.105608 Nov 19 15:11:02.892425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 568/1013] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:02 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28488 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:03.903806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:03.905065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:03.912659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:03.913138 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:03.913923 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:03.914360 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:03.992991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-75bea4d5-cfb5-4945-8a67-cf5cd8b832d3 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28656 microversion: 2.1 time: 0.093096 Nov 19 15:11:03.993625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 446/1014] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:03 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:05.005719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:05.006640 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:05.014308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:05.014750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:05.015517 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:05.015948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:05.083604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-924b0465-4309-4c2a-9038-3b614a7c0e57 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28656 microversion: 2.1 time: 0.081784 Nov 19 15:11:05.084510 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 569/1015] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:05 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28656 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:06.095811 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:06.096831 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:06.103692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:06.104145 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:06.104953 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:06.105397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:06.169751 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-efdbd89b-c5f5-4436-9850-e6baaf2ceba6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28656 microversion: 2.1 time: 0.077772 Nov 19 15:11:06.170380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 447/1016] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:06 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28656 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:07.181751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:07.182751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:07.190182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:07.190632 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:07.191412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:07.191849 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:07.265350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ce747cc4-f521-408c-8319-e4a4f21d136b tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 28656 microversion: 2.1 time: 0.087457 Nov 19 15:11:07.265973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 570/1017] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:07 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 28656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:08.277598 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:08.278656 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:08.287022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:08.287470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:08.288249 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:08.288697 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:08.376616 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-88c9fe87-b526-4682-b8ee-5019f861ca2e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 29336 microversion: 2.1 time: 0.103066 Nov 19 15:11:08.377295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 448/1018] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:08 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 29336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:09.389198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:09.390199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:09.397175 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:09.397621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:09.398390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:09.398818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:09.482242 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-023e05b0-7fa6-43c4-8c3f-82da0e158570 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 31184 microversion: 2.1 time: 0.096610 Nov 19 15:11:09.482910 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 571/1019] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:09 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 31184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:10.494328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:10.495357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:10.502664 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:10.503109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:10.503879 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:10.504310 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:10.579800 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3460aa8-abbf-4724-a4c3-72ac24dbf61e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 32688 microversion: 2.1 time: 0.089347 Nov 19 15:11:10.580419 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 449/1020] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:10 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 32688 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:11.592587 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:11.593605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:11.600368 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:11.600844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:11.601623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:11.602061 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:11.685364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-7f1a394c-5573-4c02-9be7-df64ea910c69 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 33551 microversion: 2.1 time: 0.097286 Nov 19 15:11:11.685983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 572/1021] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:11 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 33551 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:12.697780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:12.698779 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:12.705781 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:12.706232 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:12.707014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:12.707509 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:12.788237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5495c34-fb6d-4219-8587-c7ec2a6e6a78 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 34359 microversion: 2.1 time: 0.094407 Nov 19 15:11:12.788897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 450/1022] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:12 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 34359 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:13.800537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:13.801569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:13.808616 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:13.809123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:13.809901 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:13.810330 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:13.884107 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-19247667-6bc2-431d-a65a-5b4b0c59ef61 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 35326 microversion: 2.1 time: 0.087508 Nov 19 15:11:13.884714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 573/1023] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:13 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 35326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:14.896409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:14.897432 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:14.904400 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:14.904870 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:14.905644 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:14.906077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:14.984087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c543ae9-59cf-4261-ad0f-b3c4841bb3bf tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 36637 microversion: 2.1 time: 0.091599 Nov 19 15:11:14.985021 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 451/1024] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:14 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 36637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:15.996111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:15.997148 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:16.004014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:16.004472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:16.005293 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:16.005734 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:16.082608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-99418dea-c0a2-4871-84c8-87230bf5b421 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 37953 microversion: 2.1 time: 0.090558 Nov 19 15:11:16.083238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 574/1025] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:15 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 37953 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:16.970375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:16.971383 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:16.978267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:16.978723 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:16.979504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:16.979945 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.010752 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af1e718a-82c7-43cb-b38d-f3d6bc22c15a tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044448 Nov 19 15:11:17.011240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 452/1026] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Nov 19 15:11:16 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:17.066140 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:17.066728 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:17.073541 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.073996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.074887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.075323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.095329 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:17.096243 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:17.102092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:11:17.102423 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.102880 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.103669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.104108 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.174304 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bc544a43-be25-4504-83d7-a696dea06f9f tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 204 len: 0 microversion: 2.20 time: 0.111949 Nov 19 15:11:17.174887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 575/1027] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Nov 19 15:11:17 2021] DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:11:17.183097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:17.183935 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:17.189051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-819ed4f1-ae37-4425-9a30-fa72b4938082 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 38186 microversion: 2.1 time: 0.097151 Nov 19 15:11:17.190038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.190187 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 453/1028] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:17 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 38186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 15:11:17.190498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.191269 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:17.191704 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:17.321309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:17.329515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:17.331012 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:17.332156 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-09e073ad-fdc1-48ce-a750-27e483d7d149 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.152885 Nov 19 15:11:17.332705 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 576/1029] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:11:17 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 15:11:18.201747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:18.202747 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:18.209916 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:18.210422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:18.211209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:18.211648 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:18.294139 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec8ecb9e-e5d7-4816-bb4d-1925dcdad63e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 38186 microversion: 2.1 time: 0.096763 Nov 19 15:11:18.294746 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 454/1030] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:18 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 38186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:18.350809 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:18.351350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:18.357820 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:18.358264 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:18.359025 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:18.359455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:18.488753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:18.496879 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:18.498362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:18.499492 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a184465f-f043-40fe-aad3-acb2a6bb5246 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.152402 Nov 19 15:11:18.500038 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 577/1031] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:11:18 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:11:19.306562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:19.307590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:19.315261 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:19.315717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:19.316530 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:19.317007 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:19.383567 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2bec441-38f2-48e1-ae19-a979fc625c07 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 38186 microversion: 2.1 time: 0.080906 Nov 19 15:11:19.384266 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 455/1032] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:19 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 38186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:19.518153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:19.518735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:19.525011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:19.525458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:19.526238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:19.526683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:19.670990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:19.679382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:19.680938 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b5aa6372ec74ca4bed7cb5cf1677e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eaa9bd6803a47d79c92591db12100ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:19.682085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-807f0105-e7e3-48fa-8b2d-63d3fd86e923 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 200 len: 1724 microversion: 2.20 time: 0.167897 Nov 19 15:11:19.682628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 578/1033] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:11:19 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 15:11:19.919180 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-ae341e8a-5bae-4ef8-8fb8-248ebea366c9 req-c5e27914-13fd-4b08-89e0-8f967783487a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17f361-87f8-4374-aa75-1a438c25b99f", "name": "network-vif-deleted", "tag": "ee3501ca-914e-42a9-885f-d20c58f7ee17"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:19.920600 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:11:19.920600 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:11:19.928445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ae341e8a-5bae-4ef8-8fb8-248ebea366c9 req-c5e27914-13fd-4b08-89e0-8f967783487a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:19.928921 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ae341e8a-5bae-4ef8-8fb8-248ebea366c9 req-c5e27914-13fd-4b08-89e0-8f967783487a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:19.943657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-ae341e8a-5bae-4ef8-8fb8-248ebea366c9 req-c5e27914-13fd-4b08-89e0-8f967783487a service nova] Creating event network-vif-deleted:ee3501ca-914e-42a9-885f-d20c58f7ee17 for instance ba17f361-87f8-4374-aa75-1a438c25b99f on hv-cinder-81757 Nov 19 15:11:19.948026 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-ae341e8a-5bae-4ef8-8fb8-248ebea366c9 req-c5e27914-13fd-4b08-89e0-8f967783487a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033566 Nov 19 15:11:19.948845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 456/1034] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:11:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:20.395446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:20.396494 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:20.403528 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.404099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.405259 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.405869 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.494475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-102bd1f5-d3cb-4b6a-a4ed-9b8aaf1b9f05 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action" status: 200 len: 38317 microversion: 2.1 time: 0.102503 Nov 19 15:11:20.495765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 579/1035] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:11:20 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/action => generated 38317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 15:11:20.506515 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:20.508137 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:20.515369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.516066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.517099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.517740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.541607 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76690e37-e821-461e-82bb-2ccea259e68c tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039633 Nov 19 15:11:20.542273 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 457/1036] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:11:20 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:20.701755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:20.702564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:20.710535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.711124 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.712055 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:20.712775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:20.733953 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. Nov 19 15:11:20.734622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:20.735604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6c204166-5db3-4c0e-b264-948cd2e56593 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 404 len: 111 microversion: 2.20 time: 0.038212 Nov 19 15:11:20.736339 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 580/1037] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Nov 19 15:11:20 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:11:20.748455 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e32bb36b-a43d-459d-8052-e3b211846073 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '.version_select at 0x7f37c746a1f0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:20.780875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e32bb36b-a43d-459d-8052-e3b211846073 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165647573" status: 204 len: 0 microversion: 2.20 time: 0.036106 Nov 19 15:11:20.781493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 458/1038] 10.222.0.20 () {60 vars in 1261 bytes} [Fri Nov 19 15:11:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165647573 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 15:11:21.862816 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffff6a69-72bd-401f-86c8-647ff60e139e"}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:21.863861 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:21.870044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:21.870488 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:21.871398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:21.871829 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:22.104975 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dd7821aa-1a89-45a8-b343-0e52a393c92a tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245606 Nov 19 15:11:22.110651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 581/1039] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:11:21 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:22.549729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:22.550204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:22.556757 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:22.557227 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:22.557999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:22.559118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:22.571678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. Nov 19 15:11:22.572254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:22.573095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13813edf-3ee4-4fd8-b249-fbc7d3c1cb7d tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 404 len: 111 microversion: 2.1 time: 0.027517 Nov 19 15:11:22.573627 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 459/1040] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:11:22 2021] DELETE /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:22.581751 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:22.582447 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: ba17f361-87f8-4374-aa75-1a438c25b99f] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:22.589106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:22.589563 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:22.590356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:22.590783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:22.603240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. Nov 19 15:11:22.603812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance ba17f361-87f8-4374-aa75-1a438c25b99f could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:22.604602 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b14b6e3c-b485-47f1-8a4e-9cbb6129d087 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f" status: 404 len: 111 microversion: 2.1 time: 0.026759 Nov 19 15:11:22.605628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 582/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:22 2021] GET /compute/v2.1/servers/ba17f361-87f8-4374-aa75-1a438c25b99f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:23.728402 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:23.728927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:23.735229 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:23.735667 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:23.736435 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:23.736902 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:23.750194 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. Nov 19 15:11:23.750772 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:23.751618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e36e163-0fbe-4897-a247-5080cc4ebea6 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 404 len: 111 microversion: 2.1 time: 0.026913 Nov 19 15:11:23.752154 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 460/1042] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:11:23 2021] DELETE /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:23.759802 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:23.760406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] [instance: 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:23.767181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:23.767621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:23.768386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:23.768841 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:23.781548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] HTTP exception thrown: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. Nov 19 15:11:23.782122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] Returning 404 to user: Instance 084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:23.782918 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6e29c80b-69d5-4b2a-b91d-e2d21fb05b50 tempest-AttachVolumeShelveTestJSON-310796889 tempest-AttachVolumeShelveTestJSON-310796889-project] 10.222.0.20 "GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82" status: 404 len: 111 microversion: 2.1 time: 0.026708 Nov 19 15:11:23.783427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 583/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:23 2021] GET /compute/v2.1/servers/084f3bb6-2fa2-4b60-985e-61c8b8f2fc82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:28.087166 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-68714f07-6354-4336-8407-505d65b5172d tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Action: 'create', calling method: .version_select at 0x7f37c73b1700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-748149972", "metadata": {"Type": "work"}}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:28.088590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-68714f07-6354-4336-8407-505d65b5172d tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.089464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-68714f07-6354-4336-8407-505d65b5172d tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.114619 Nov 19 15:11:28.089998 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 461/1044] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Nov 19 15:11:27 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:11:28.098972 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33fa4ebb-14e9-4ae8-820f-1495809cdb1a tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Action: 'create', calling method: .version_select at 0x7f37c74e8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-615979174", "metadata": {"Type": "work"}}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:28.100468 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-33fa4ebb-14e9-4ae8-820f-1495809cdb1a tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.101301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-33fa4ebb-14e9-4ae8-820f-1495809cdb1a tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005986 Nov 19 15:11:28.101801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 584/1045] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Nov 19 15:11:28 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:11:28.110328 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5d37b2b9-4ac7-481e-9cb7-c6e2fc848918 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Action: 'create', calling method: .version_select at 0x7f37d061ddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1149406666", "metadata": {"Type": "work"}}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:28.113947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5d37b2b9-4ac7-481e-9cb7-c6e2fc848918 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.114735 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5d37b2b9-4ac7-481e-9cb7-c6e2fc848918 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007852 Nov 19 15:11:28.115238 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 462/1046] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Nov 19 15:11:28 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 15:11:28.124376 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6fb85dc8-09c0-409e-b5f7-325a6940bdd9 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Calling method '.version_select at 0x7f37c7568d30>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:28.151882 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-6fb85dc8-09c0-409e-b5f7-325a6940bdd9 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] HTTP exception thrown: Volume tempest-invalid-688004952 could not be found. Nov 19 15:11:28.152533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6fb85dc8-09c0-409e-b5f7-325a6940bdd9 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 404 to user: Volume tempest-invalid-688004952 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.153383 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6fb85dc8-09c0-409e-b5f7-325a6940bdd9 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-688004952" status: 404 len: 98 microversion: 2.1 time: 0.033596 Nov 19 15:11:28.153911 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 585/1047] 10.222.0.20 () {58 vars in 1214 bytes} [Fri Nov 19 15:11:28 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-688004952 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 19 15:11:28.162854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf866eb2-fb84-40a0-bdd8-2501ac61f2a1 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003517 Nov 19 15:11:28.163348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 463/1048] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Nov 19 15:11:28 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 15:11:28.171556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-aed7569f-b3ef-4283-9003-d5639c709308 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003940 Nov 19 15:11:28.172044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 586/1049] 10.222.0.20 () {58 vars in 1136 bytes} [Fri Nov 19 15:11:28 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 15:11:28.179692 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9d62553-cb5a-4516-aca0-75f81d54d271 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Calling method '.version_select at 0x7f37c7630550>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:28.206604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-b9d62553-cb5a-4516-aca0-75f81d54d271 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] HTTP exception thrown: Volume 44010736-e438-4b98-89fe-64f74298e99c could not be found. Nov 19 15:11:28.207217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9d62553-cb5a-4516-aca0-75f81d54d271 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 404 to user: Volume 44010736-e438-4b98-89fe-64f74298e99c could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.208022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9d62553-cb5a-4516-aca0-75f81d54d271 tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/44010736-e438-4b98-89fe-64f74298e99c" status: 404 len: 109 microversion: 2.1 time: 0.031660 Nov 19 15:11:28.208552 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 464/1050] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Nov 19 15:11:28 2021] DELETE /compute/v2.1/os-volumes/44010736-e438-4b98-89fe-64f74298e99c => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:28.217968 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c8b24770-be75-4a95-abfc-3fcac62a32cd tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Calling method '.version_select at 0x7f37c7483ee0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:28.243976 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-c8b24770-be75-4a95-abfc-3fcac62a32cd tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] HTTP exception thrown: Volume 4219353e-8945-4695-9edc-32188fe29352 could not be found. Nov 19 15:11:28.244642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c8b24770-be75-4a95-abfc-3fcac62a32cd tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] Returning 404 to user: Volume 4219353e-8945-4695-9edc-32188fe29352 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:28.245495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c8b24770-be75-4a95-abfc-3fcac62a32cd tempest-VolumesNegativeTest-1408870276 tempest-VolumesNegativeTest-1408870276-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4219353e-8945-4695-9edc-32188fe29352" status: 404 len: 109 microversion: 2.1 time: 0.031623 Nov 19 15:11:28.246062 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 587/1051] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:11:28 2021] GET /compute/v2.1/os-volumes/4219353e-8945-4695-9edc-32188fe29352 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:28.546635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:28.547565 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:28.554335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:28.554780 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:28.555560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:28.555997 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:28.587267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d249436-4179-4942-a1d5-06279b7d2508 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Nov 19 15:11:28.587823 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 465/1052] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:11:28 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:28.598191 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:28.598676 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:28.605097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:28.605543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:28.606498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:28.606933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:28.635144 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2d1464b3-5bcd-48bb-807b-cadfb4c77de6 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e" status: 200 len: 194 microversion: 2.1 time: 0.040525 Nov 19 15:11:28.635715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 588/1053] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Nov 19 15:11:28 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:29.970066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a61aac-0cb7-4ecf-bc22-8f40a4793497"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:29.971120 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:29.977591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:29.978044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:29.978867 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:29.979297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:30.230741 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-662a46ae-c888-4a4e-b996-7d8df308bdf4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264033 Nov 19 15:11:30.232583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 466/1054] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Nov 19 15:11:29 2021] POST /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:37.722417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:37.723387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:37.730446 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:37.731212 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:37.733407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:37.733961 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:37.764071 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b7ae1238-40f9-4666-9fe5-6a1efd1825e7 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045354 Nov 19 15:11:37.764606 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 589/1055] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:11:37 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:38.062908 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:38.063449 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:38.069625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:38.070074 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:38.070857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:38.071297 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:38.099817 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2169cca3-3c3a-4263-8732-665bfc54bb70 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e" status: 200 len: 194 microversion: 2.1 time: 0.042151 Nov 19 15:11:38.100387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 467/1056] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Nov 19 15:11:38 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:38.109876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:38.110364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:38.116122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:38.116550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:38.117349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:38.117782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:38.192427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lazy-loading 'services' on Instance uuid 31b51e89-d3f8-4801-bb3d-c022acdb340c {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:11:38.260041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0aca42cf-7c28-4ab2-a5fd-3831486dfbe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e" status: 202 len: 0 microversion: 2.1 time: 0.153719 Nov 19 15:11:38.260622 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 590/1057] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:11:38 2021] DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/ffff6a69-72bd-401f-86c8-647ff60e139e => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:11:42.515534 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:42.516028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:42.522349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:42.522833 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:42.523617 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:42.524055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:42.551522 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76d7b165-8cbe-4637-b7ec-c232d353948d tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/c7a61aac-0cb7-4ecf-bc22-8f40a4793497" status: 200 len: 194 microversion: 2.1 time: 0.040480 Nov 19 15:11:42.552099 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 468/1058] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Nov 19 15:11:42 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/c7a61aac-0cb7-4ecf-bc22-8f40a4793497 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:42.563017 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:42.563618 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:42.569581 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:42.570024 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:42.570792 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:42.571221 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:42.646813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lazy-loading 'services' on Instance uuid 31b51e89-d3f8-4801-bb3d-c022acdb340c {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:11:42.715098 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-39d15869-923d-4a89-8c66-df7a6eb7e910 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/c7a61aac-0cb7-4ecf-bc22-8f40a4793497" status: 202 len: 0 microversion: 2.1 time: 0.157050 Nov 19 15:11:42.715749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 591/1059] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Nov 19 15:11:42 2021] DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments/c7a61aac-0cb7-4ecf-bc22-8f40a4793497 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:11:43.876812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:43.877819 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:43.883895 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:43.884336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:43.885140 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:43.885578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:43.914453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ccb2d4f-ef54-4059-8f6e-91909ec28b59 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041255 Nov 19 15:11:43.915002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 469/1060] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:11:43 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:11:44.014465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:44.015515 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:44.021561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.022007 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.022783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.023217 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.051698 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-adb5b4e5-b515-4cb6-8219-9b1052a0a18f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041810 Nov 19 15:11:44.052240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 592/1061] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Nov 19 15:11:44 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 15:11:44.106816 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:44.107341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:44.113279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.113729 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.114540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.115150 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.139269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:11:44.218872 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3560a009-e679-4adf-9a6c-8ea64b2d241f tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 204 len: 0 microversion: 2.1 time: 0.116245 Nov 19 15:11:44.219688 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 470/1062] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:11:44 2021] DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:11:44.227722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:44.228335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:44.234798 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.235234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.236010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:44.236449 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:44.370294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:44.377613 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-719f6905-1b5b-4dc9-a31f-1fd32eb35994 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1674 microversion: 2.1 time: 0.153512 Nov 19 15:11:44.378209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 593/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:44 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:45.395137 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:45.395918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:45.402905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:45.403521 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:45.404282 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:45.404810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:45.538006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:45.545485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6553ba85-f108-44d4-b299-538cc08f1379 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1674 microversion: 2.1 time: 0.154368 Nov 19 15:11:45.546052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 471/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:45 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:46.563523 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:46.564251 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:46.572139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:46.572834 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:46.574387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:46.574996 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:46.717666 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f36e6f35a5e944429f0e1779651c807d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e2bcec34734e86900951518afe4cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:46.725216 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-eb1b5aff-27a7-443c-b02c-82dc6f889ae8 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 200 len: 1674 microversion: 2.1 time: 0.166360 Nov 19 15:11:46.725978 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 594/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:46 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:11:47.195560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-7d5f5bbd-8b32-42d9-8b49-c7c972b72d69 req-58d3582c-2189-4266-a672-f3820a2815c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b51e89-d3f8-4801-bb3d-c022acdb340c", "name": "network-vif-deleted", "tag": "81381387-9554-484f-96f4-ccedc01e4bd8"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:47.197475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:11:47.197475 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:11:47.206553 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-7d5f5bbd-8b32-42d9-8b49-c7c972b72d69 req-58d3582c-2189-4266-a672-f3820a2815c6 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:47.207513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-7d5f5bbd-8b32-42d9-8b49-c7c972b72d69 req-58d3582c-2189-4266-a672-f3820a2815c6 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:47.220810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-7d5f5bbd-8b32-42d9-8b49-c7c972b72d69 req-58d3582c-2189-4266-a672-f3820a2815c6 service nova] Creating event network-vif-deleted:81381387-9554-484f-96f4-ccedc01e4bd8 for instance 31b51e89-d3f8-4801-bb3d-c022acdb340c on hv-cinder-81757 Nov 19 15:11:47.226646 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-7d5f5bbd-8b32-42d9-8b49-c7c972b72d69 req-58d3582c-2189-4266-a672-f3820a2815c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034714 Nov 19 15:11:47.228136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 472/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:11:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:47.742731 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:47.743328 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:47.755220 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:47.755804 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:47.756909 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:47.757771 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:47.773522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. Nov 19 15:11:47.774170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:47.775234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-42ba8e85-5fcb-4c96-98b2-1a0043a5ba53 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 404 len: 111 microversion: 2.1 time: 0.036274 Nov 19 15:11:47.776950 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 595/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:47 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:47.787541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-669b6b42-3113-4fa6-9cb7-a4c56068ee5e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '.version_select at 0x7f37c73b1700>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:47.808917 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-669b6b42-3113-4fa6-9cb7-a4c56068ee5e tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777279953" status: 202 len: 0 microversion: 2.1 time: 0.026527 Nov 19 15:11:47.809563 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 473/1068] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Nov 19 15:11:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777279953 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:11:49.765403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1384118772", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "7a18a446-8a23-4243-853b-e68a1175083f"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:49.820014 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] validate_networks() for [('7a18a446-8a23-4243-853b-e68a1175083f', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:11:50.364218 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:11:50.364636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:11:50.365166 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:11:50.365566 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:11:50.365971 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:11:50.374490 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.374931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.375733 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.376164 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.392393 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Getting quotas for project 5702309f7a864574ae451538a7e4f25f. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:11:50.396182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Getting quotas for user fe9c73b666d14aba9396322efa1e16ec and project 5702309f7a864574ae451538a7e4f25f. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:11:50.407411 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:11:50.409730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:11:50.453762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-10a8d76c-3107-415e-9a5f-8985d50bbb45 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691908 Nov 19 15:11:50.454398 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 596/1069] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:11:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:11:50.465394 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5db60df8-96d6-4153-aa69-d025066c4ef8 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:50.466130 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5db60df8-96d6-4153-aa69-d025066c4ef8 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:50.523209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5db60df8-96d6-4153-aa69-d025066c4ef8 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:50.531377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5db60df8-96d6-4153-aa69-d025066c4ef8 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1214 microversion: 2.1 time: 0.070758 Nov 19 15:11:50.531933 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 474/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:50 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:50.917086 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:50.917665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:50.923740 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.924182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.924973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.925405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.939335 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. Nov 19 15:11:50.939931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:50.940878 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-791763cf-18fe-4bd3-adb6-5e9dce72c765 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 404 len: 111 microversion: 2.1 time: 0.028002 Nov 19 15:11:50.941703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 597/1071] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:11:50 2021] DELETE /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:50.949758 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:50.950456 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 31b51e89-d3f8-4801-bb3d-c022acdb340c] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:50.956378 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.956859 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.957653 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:50.958075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:50.971342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. Nov 19 15:11:50.971963 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 31b51e89-d3f8-4801-bb3d-c022acdb340c could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:50.972774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-661a9fa1-ddf1-4c72-8953-71f75d08bfe0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c" status: 404 len: 111 microversion: 2.1 time: 0.027263 Nov 19 15:11:50.973325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 475/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:50 2021] GET /compute/v2.1/servers/31b51e89-d3f8-4801-bb3d-c022acdb340c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:51.547943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:51.548555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:51.554495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:51.554944 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:51.555729 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:51.556170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:51.616600 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:51.625091 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cc4c3717-ec2d-4509-a13a-0814e1cd6beb tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1272 microversion: 2.1 time: 0.080822 Nov 19 15:11:51.625724 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 598/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:51 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:52.117566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:52.118125 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:52.125832 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.126356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.127222 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.127739 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.141381 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. Nov 19 15:11:52.141970 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:52.142828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2161e731-1bb3-47fd-a532-583227c63ba4 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 404 len: 111 microversion: 2.1 time: 0.028900 Nov 19 15:11:52.143363 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 476/1074] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:11:52 2021] DELETE /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:11:52.151445 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:52.152377 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] [instance: 28d60727-6b69-40d5-81e4-79f73038581b] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:52.158933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.159456 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.160306 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.160815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.174782 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] HTTP exception thrown: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. Nov 19 15:11:52.175448 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] Returning 404 to user: Instance 28d60727-6b69-40d5-81e4-79f73038581b could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:11:52.176499 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2eeee4af-19be-4f40-85c1-1691fec33cb0 tempest-AttachVolumeTestJSON-1649248005 tempest-AttachVolumeTestJSON-1649248005-project] 10.222.0.20 "GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b" status: 404 len: 111 microversion: 2.1 time: 0.028885 Nov 19 15:11:52.177145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 599/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:52 2021] GET /compute/v2.1/servers/28d60727-6b69-40d5-81e4-79f73038581b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:11:52.642085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:52.643041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:52.648652 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.649213 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.649947 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.650382 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.668180 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-703cbd24-062a-48c3-a3d5-51dd14566164 req-01d0e683-bd42-41cb-9714-2ee212173c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fead7a-c17f-4319-9cd3-edb1abe82b92", "tag": "0080f472-a984-42e8-803c-7fe7b9fd1b93"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:52.674805 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:11:52.674805 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:11:52.695540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-703cbd24-062a-48c3-a3d5-51dd14566164 req-01d0e683-bd42-41cb-9714-2ee212173c57 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:52.695999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-703cbd24-062a-48c3-a3d5-51dd14566164 req-01d0e683-bd42-41cb-9714-2ee212173c57 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:52.707475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-703cbd24-062a-48c3-a3d5-51dd14566164 req-01d0e683-bd42-41cb-9714-2ee212173c57 service nova] Creating event network-changed:0080f472-a984-42e8-803c-7fe7b9fd1b93 for instance 23fead7a-c17f-4319-9cd3-edb1abe82b92 on hv-cinder-81757 Nov 19 15:11:52.713572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-703cbd24-062a-48c3-a3d5-51dd14566164 req-01d0e683-bd42-41cb-9714-2ee212173c57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057718 Nov 19 15:11:52.715002 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 600/1076] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:11:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:53.150851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:53.158797 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a38855d4-025a-46cb-8914-8bbbc57659e5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.520308 Nov 19 15:11:53.168055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 477/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:52 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:54.177113 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:54.178831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:54.185843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:54.186642 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:54.187599 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:54.188255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:54.450971 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:54.458315 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-bb4970b7-20d8-4b1a-9710-8d54ca4953e0 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.286180 Nov 19 15:11:54.459228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 601/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:54 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:55.475295 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:55.475989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:55.483094 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:55.483643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:55.484488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:55.485035 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:55.626041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:55.633162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f0db0aa-d98b-4183-9252-116df4024699 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.161622 Nov 19 15:11:55.633720 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 478/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:55 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:56.650787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:56.652153 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:56.659476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:56.660178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:56.661001 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:56.661440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:56.805662 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:56.814942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f2b1b433-2307-42d5-9aee-a607e5bd9cf3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.167760 Nov 19 15:11:56.815989 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 602/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:56 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:57.839572 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:57.840204 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:57.846632 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:57.847284 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:57.848063 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:57.848495 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:57.926756 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-780bfdfa-f15c-4659-8e18-8f6a17e235c7 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c74a21f0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:57.971727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-780bfdfa-f15c-4659-8e18-8f6a17e235c7 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bc1b0770-7fda-4395-b714-0fafe5fbc97a" status: 200 len: 351 microversion: 2.1 time: 0.048809 Nov 19 15:11:57.972418 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 603/1081] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:11:57 2021] GET /compute/v2.1/os-volumes/bc1b0770-7fda-4395-b714-0fafe5fbc97a => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:11:57.980175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:57.987992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9402a098-610a-4508-ba6f-5c5e296f0ea5 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.152079 Nov 19 15:11:57.988563 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 479/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:57 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:58.619475 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-9f2dab2f-3c50-40a5-b394-4b504c509ddc req-f0001716-6aab-4bb8-8d35-dca6393ee81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fead7a-c17f-4319-9cd3-edb1abe82b92", "name": "network-vif-plugged", "status": "completed", "tag": "0080f472-a984-42e8-803c-7fe7b9fd1b93"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:11:58.621980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:11:58.621980 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:11:58.630032 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9f2dab2f-3c50-40a5-b394-4b504c509ddc req-f0001716-6aab-4bb8-8d35-dca6393ee81b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:58.630476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9f2dab2f-3c50-40a5-b394-4b504c509ddc req-f0001716-6aab-4bb8-8d35-dca6393ee81b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:58.642489 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-9f2dab2f-3c50-40a5-b394-4b504c509ddc req-f0001716-6aab-4bb8-8d35-dca6393ee81b service nova] Creating event network-vif-plugged:0080f472-a984-42e8-803c-7fe7b9fd1b93 for instance 23fead7a-c17f-4319-9cd3-edb1abe82b92 on hv-cinder-81757 Nov 19 15:11:58.647931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-9f2dab2f-3c50-40a5-b394-4b504c509ddc req-f0001716-6aab-4bb8-8d35-dca6393ee81b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Nov 19 15:11:58.648518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 604/1083] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:11:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:11:59.004412 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:59.005062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:11:59.011986 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:59.012439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:59.013252 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:11:59.013696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:11:59.141032 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:11:59.148080 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb523e94-4ca0-4a4b-ac2c-b583b5d1eedc tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1314 microversion: 2.1 time: 0.147350 Nov 19 15:11:59.148639 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 480/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:11:58 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:11:59.269995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-65d9e41b-8116-4913-9f66-df94381fe945 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c7467670>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:11:59.315210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-65d9e41b-8116-4913-9f66-df94381fe945 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d6f55820-2a6a-469c-80a5-aaae867bae74" status: 200 len: 350 microversion: 2.1 time: 0.049031 Nov 19 15:11:59.315765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 605/1085] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:11:59 2021] GET /compute/v2.1/os-volumes/d6f55820-2a6a-469c-80a5-aaae867bae74 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:12:00.164375 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.165025 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:00.176278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.176735 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.177613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.178052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.310482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:00.317731 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-30374eb4-2bfe-410d-aeca-f0d2e04e2e1e tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1498 microversion: 2.1 time: 0.157038 Nov 19 15:12:00.318292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 481/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:00.615660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fd1ec674-8b60-4a6e-b525-d897369572ba tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c74e3790>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.674270 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fd1ec674-8b60-4a6e-b525-d897369572ba tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6a8cd170-57cf-4be6-a877-67f032cebec3" status: 200 len: 350 microversion: 2.1 time: 0.063530 Nov 19 15:12:00.674844 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 606/1087] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/os-volumes/6a8cd170-57cf-4be6-a877-67f032cebec3 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:00.686211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-573dc2da-4473-434a-bad3-df5bafb9e9c2 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37d060e9d0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.710553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.711158 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:00.718616 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.719065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.719836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.720268 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.744760 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:12:00.765296 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-573dc2da-4473-434a-bad3-df5bafb9e9c2 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082961 Nov 19 15:12:00.765858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 482/1088] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:00.777717 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9bedfae9-6268-4d82-a3c7-9bb91bdc51a8 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37d065ad30>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.837122 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8eb87e6f-f110-4fe8-a664-d5ab510a1481 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 204 len: 0 microversion: 2.1 time: 0.130243 Nov 19 15:12:00.837716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 607/1089] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:12:00 2021] DELETE /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:12:00.846312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:00.846998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:00.852688 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.853110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.854134 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:00.854427 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:00.865906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9bedfae9-6268-4d82-a3c7-9bb91bdc51a8 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091988 Nov 19 15:12:00.866829 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 483/1090] 10.222.0.20 () {58 vars in 1148 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:12:00.879197 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e2ed319-83b9-4242-bed6-6bd68ceae757 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c746aaf0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.003519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:01.012073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-fd3fd686-13e9-4d89-a6b1-64a51578f639 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1504 microversion: 2.1 time: 0.169409 Nov 19 15:12:01.012664 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 608/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:01.109253 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e2ed319-83b9-4242-bed6-6bd68ceae757 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.233431 Nov 19 15:12:01.109815 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 484/1092] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Nov 19 15:12:00 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:01.120525 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3d424866-e087-4356-8da8-e0d5db5c7449 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c7532940>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.199035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3d424866-e087-4356-8da8-e0d5db5c7449 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082012 Nov 19 15:12:01.199595 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 609/1093] 10.222.0.20 () {58 vars in 1166 bytes} [Fri Nov 19 15:12:01 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:01.212030 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f2ac7369-1742-4c0f-ad4a-e96c356c9b7f tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37d065a820>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.289069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f2ac7369-1742-4c0f-ad4a-e96c356c9b7f tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081125 Nov 19 15:12:01.289621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 485/1094] 10.222.0.20 () {58 vars in 1169 bytes} [Fri Nov 19 15:12:01 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:01.301252 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0b127f65-e232-4901-9fc4-547120cf214b tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c74a2670>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.381560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0b127f65-e232-4901-9fc4-547120cf214b tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083707 Nov 19 15:12:01.382123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 610/1095] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Nov 19 15:12:01 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:01.393533 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5919fc3a-9f65-46e9-8d39-57dcec4aed21 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c73b1dc0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.473748 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5919fc3a-9f65-46e9-8d39-57dcec4aed21 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083656 Nov 19 15:12:01.474303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 486/1096] 10.222.0.20 () {58 vars in 1187 bytes} [Fri Nov 19 15:12:01 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:01.485375 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0ac8337a-890b-46b7-a725-424b89e2bef9 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] Calling method '.version_select at 0x7f37c7472d30>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:01.725666 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0ac8337a-890b-46b7-a725-424b89e2bef9 tempest-VolumesTestJSON-284495387 tempest-VolumesTestJSON-284495387-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243692 Nov 19 15:12:01.726226 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 611/1097] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Nov 19 15:12:01 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:02.029228 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:02.030304 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:02.036445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:02.036926 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:02.037699 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:02.038134 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:02.171812 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:02.178991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c56ad858-dd10-4cdd-b42f-dfaf0333d691 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1504 microversion: 2.1 time: 0.153862 Nov 19 15:12:02.179640 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 487/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:02 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:02.766323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-9f94a477-be06-40ae-879b-07549e3a888f req-b0364338-090b-4b04-8d82-6a490ddee31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fead7a-c17f-4319-9cd3-edb1abe82b92", "name": "network-vif-deleted", "tag": "0080f472-a984-42e8-803c-7fe7b9fd1b93"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:02.767890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:02.767890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:12:02.775097 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9f94a477-be06-40ae-879b-07549e3a888f req-b0364338-090b-4b04-8d82-6a490ddee31e service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:02.775535 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-9f94a477-be06-40ae-879b-07549e3a888f req-b0364338-090b-4b04-8d82-6a490ddee31e service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:02.786909 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-9f94a477-be06-40ae-879b-07549e3a888f req-b0364338-090b-4b04-8d82-6a490ddee31e service nova] Creating event network-vif-deleted:0080f472-a984-42e8-803c-7fe7b9fd1b93 for instance 23fead7a-c17f-4319-9cd3-edb1abe82b92 on hv-cinder-81757 Nov 19 15:12:02.792480 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-9f94a477-be06-40ae-879b-07549e3a888f req-b0364338-090b-4b04-8d82-6a490ddee31e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030127 Nov 19 15:12:02.793103 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 612/1099] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:03.196341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:03.196968 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:03.203259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:03.203704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:03.204471 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:03.204927 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:03.235212 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:03.235659 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:03.236101 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lazy-loading 'fault' on Instance uuid 23fead7a-c17f-4319-9cd3-edb1abe82b92 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:12:03.274562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:03.281726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-454fe6f5-c8d6-41af-867d-8021fee91924 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 200 len: 1304 microversion: 2.1 time: 0.089102 Nov 19 15:12:03.282278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 488/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:03 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:04.299501 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:04.300197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 23fead7a-c17f-4319-9cd3-edb1abe82b92] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:04.306237 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:04.306681 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:04.308178 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:04.308608 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:04.321181 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] HTTP exception thrown: Instance 23fead7a-c17f-4319-9cd3-edb1abe82b92 could not be found. Nov 19 15:12:04.321755 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Returning 404 to user: Instance 23fead7a-c17f-4319-9cd3-edb1abe82b92 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:12:04.322548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0bc12f20-3141-477b-85a9-45ce32828ce7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92" status: 404 len: 111 microversion: 2.1 time: 0.027557 Nov 19 15:12:04.323709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 613/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:04 2021] GET /compute/v2.1/servers/23fead7a-c17f-4319-9cd3-edb1abe82b92 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:12:04.414932 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-425958317", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452", "networks": [{"uuid": "7a18a446-8a23-4243-853b-e68a1175083f"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:04.466077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] validate_networks() for [('7a18a446-8a23-4243-853b-e68a1175083f', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:12:04.816527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:12:04.817003 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:12:04.817484 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:12:04.817899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:12:04.818387 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:12:04.828288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:04.828678 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:04.829611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:04.830056 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:04.846705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Getting quotas for project 5702309f7a864574ae451538a7e4f25f. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:12:04.850591 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Getting quotas for user fe9c73b666d14aba9396322efa1e16ec and project 5702309f7a864574ae451538a7e4f25f. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:12:04.861117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:12:04.863522 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:12:04.907560 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b25ddbda-0837-47a0-b236-085937e7c6c7 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496343 Nov 19 15:12:04.908199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 489/1102] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:12:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:12:04.917923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-545b85e4-d133-4890-a5c9-72459c0f7992 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:04.918536 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-545b85e4-d133-4890-a5c9-72459c0f7992 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:04.971154 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-545b85e4-d133-4890-a5c9-72459c0f7992 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:04.977437 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-545b85e4-d133-4890-a5c9-72459c0f7992 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1213 microversion: 2.1 time: 0.063315 Nov 19 15:12:04.977992 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 614/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:04 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:05.995962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:05.998397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:06.006879 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:06.007616 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:06.008666 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:06.009202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:06.109540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:06.117663 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4bdfff4a-278c-4634-bd0c-5ec1180373f4 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1271 microversion: 2.1 time: 0.127615 Nov 19 15:12:06.118468 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 490/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:05 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:07.135332 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:07.135899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:07.143442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:07.143986 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:07.144908 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:07.145413 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:07.309544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:07.312548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-0afcacc6-693b-4bf3-9972-2b58c1cbf5fb req-9fc731c9-299d-4d01-8e19-2f3e2a331e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b13842-6c63-4067-9fe4-1dbc1ab8b59d", "tag": "0d7876f4-302b-4dcd-881f-97eed70ba1e7"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:07.314850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:07.314850 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:12:07.319520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-50a16d8d-67ce-4a41-991a-8258a31626c1 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.187861 Nov 19 15:12:07.320231 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 615/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:07 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:07.340813 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0afcacc6-693b-4bf3-9972-2b58c1cbf5fb req-9fc731c9-299d-4d01-8e19-2f3e2a331e80 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:07.341491 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0afcacc6-693b-4bf3-9972-2b58c1cbf5fb req-9fc731c9-299d-4d01-8e19-2f3e2a331e80 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:07.355141 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-0afcacc6-693b-4bf3-9972-2b58c1cbf5fb req-9fc731c9-299d-4d01-8e19-2f3e2a331e80 service nova] Creating event network-changed:0d7876f4-302b-4dcd-881f-97eed70ba1e7 for instance 32b13842-6c63-4067-9fe4-1dbc1ab8b59d on hv-cinder-81757 Nov 19 15:12:07.360169 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-0afcacc6-693b-4bf3-9972-2b58c1cbf5fb req-9fc731c9-299d-4d01-8e19-2f3e2a331e80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056987 Nov 19 15:12:07.361323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 491/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:12:08.337708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:08.338946 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:08.345205 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:08.345655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:08.346435 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:08.346939 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:08.488440 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:08.495672 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b89e6adf-6e45-4d3d-8cad-c871dc8753ca tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.161856 Nov 19 15:12:08.496243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 616/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:08 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:09.512551 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:09.513259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:09.519118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:09.519562 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:09.520345 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:09.520866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:09.663280 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:09.670842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-892dfebd-b4c2-4398-8c53-dc2f1d3f5756 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.162598 Nov 19 15:12:09.671380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 492/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:09 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:10.687585 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:10.688199 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:10.694505 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:10.694942 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:10.695715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:10.696145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:10.977634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:10.984923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cc59d8c4-a3c1-43f9-9e36-d73e095d71db tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.301325 Nov 19 15:12:10.985467 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 617/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:10 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:12.001718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:12.002344 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:12.008876 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:12.009336 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:12.010923 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:12.011506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:12.152862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:12.161968 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2deb17a3-0378-4964-86e9-cb03a457fd32 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.163880 Nov 19 15:12:12.162696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 493/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:11 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:12.723650 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-e65b555b-300c-4dd6-8d5f-39935d38836f req-5f9ead16-b111-4950-a365-3334f9e403f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b13842-6c63-4067-9fe4-1dbc1ab8b59d", "name": "network-vif-plugged", "status": "completed", "tag": "0d7876f4-302b-4dcd-881f-97eed70ba1e7"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:12.728425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:12.728425 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:12:12.735370 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e65b555b-300c-4dd6-8d5f-39935d38836f req-5f9ead16-b111-4950-a365-3334f9e403f9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:12.736023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e65b555b-300c-4dd6-8d5f-39935d38836f req-5f9ead16-b111-4950-a365-3334f9e403f9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:12.753567 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-e65b555b-300c-4dd6-8d5f-39935d38836f req-5f9ead16-b111-4950-a365-3334f9e403f9 service nova] Creating event network-vif-plugged:0d7876f4-302b-4dcd-881f-97eed70ba1e7 for instance 32b13842-6c63-4067-9fe4-1dbc1ab8b59d on hv-cinder-81757 Nov 19 15:12:12.759210 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-e65b555b-300c-4dd6-8d5f-39935d38836f req-5f9ead16-b111-4950-a365-3334f9e403f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040390 Nov 19 15:12:12.760229 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 618/1111] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:13.181356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:13.182507 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:13.188743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:13.189233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:13.190004 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:13.190476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:13.324547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:13.331795 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5919160c-db45-4b86-832e-cecbac4d36f3 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1313 microversion: 2.1 time: 0.154133 Nov 19 15:12:13.332445 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 494/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:13 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:14.349661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:14.350485 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:14.356533 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:14.357016 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:14.357794 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:14.358228 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:14.490336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:14.497935 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-782e16f1-cb2c-4fd6-9887-10b71aedc42f tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1497 microversion: 2.1 time: 0.152809 Nov 19 15:12:14.498483 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 619/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:14 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:14.938190 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:14.938733 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:14.945292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:14.945862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:14.946649 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:14.947082 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:14.972628 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:12:15.045816 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eab57e4f-856d-413d-964e-ad9a88cea865 tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 204 len: 0 microversion: 2.1 time: 0.111133 Nov 19 15:12:15.046540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 495/1114] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:12:14 2021] DELETE /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:12:15.054572 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:15.055329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:15.062095 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:15.062655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:15.063495 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:15.064073 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:15.199745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:15.207195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-c693a770-ebc3-48d3-bc3d-37fe40d6cecd tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1503 microversion: 2.1 time: 0.156156 Nov 19 15:12:15.207758 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 620/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:15 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:16.225259 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:16.225893 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:16.232602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:16.233085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:16.233866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:16.234303 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:16.365988 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:16.373266 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-396cc137-1fdb-46b0-af49-1542859d1d9a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1503 microversion: 2.1 time: 0.152400 Nov 19 15:12:16.373827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 496/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:16 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:17.004039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-83c03162-7243-4139-8fdf-72fa192b8afa req-a7950cde-b8e9-4768-b853-de9034bd51c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b13842-6c63-4067-9fe4-1dbc1ab8b59d", "name": "network-vif-deleted", "tag": "0d7876f4-302b-4dcd-881f-97eed70ba1e7"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:17.006200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:17.006200 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:12:17.013814 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-83c03162-7243-4139-8fdf-72fa192b8afa req-a7950cde-b8e9-4768-b853-de9034bd51c9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:17.014257 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-83c03162-7243-4139-8fdf-72fa192b8afa req-a7950cde-b8e9-4768-b853-de9034bd51c9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:17.025916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-83c03162-7243-4139-8fdf-72fa192b8afa req-a7950cde-b8e9-4768-b853-de9034bd51c9 service nova] Creating event network-vif-deleted:0d7876f4-302b-4dcd-881f-97eed70ba1e7 for instance 32b13842-6c63-4067-9fe4-1dbc1ab8b59d on hv-cinder-81757 Nov 19 15:12:17.031107 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-83c03162-7243-4139-8fdf-72fa192b8afa req-a7950cde-b8e9-4768-b853-de9034bd51c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Nov 19 15:12:17.031697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 621/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:17.390915 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:17.391520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:17.398116 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:17.398765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:17.399543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:17.399973 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:17.432443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:17.433060 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:17.433665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lazy-loading 'fault' on Instance uuid 32b13842-6c63-4067-9fe4-1dbc1ab8b59d {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:12:17.478418 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9c73b666d14aba9396322efa1e16ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5702309f7a864574ae451538a7e4f25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:17.487590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1d7036fe-598e-494a-93bb-a9cfeb759a5a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 200 len: 1303 microversion: 2.1 time: 0.100176 Nov 19 15:12:17.488233 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 497/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:17 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:18.505570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:18.506290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] [instance: 32b13842-6c63-4067-9fe4-1dbc1ab8b59d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:18.512500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:18.512981 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:18.513750 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:18.514185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:18.529428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] HTTP exception thrown: Instance 32b13842-6c63-4067-9fe4-1dbc1ab8b59d could not be found. Nov 19 15:12:18.529952 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] Returning 404 to user: Instance 32b13842-6c63-4067-9fe4-1dbc1ab8b59d could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:12:18.530761 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-6420e939-0c31-4f07-8fd4-77841caa636a tempest-VolumesActionsTest-667915026 tempest-VolumesActionsTest-667915026-project] 10.222.0.20 "GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d" status: 404 len: 111 microversion: 2.1 time: 0.029713 Nov 19 15:12:18.531283 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 622/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:18 2021] GET /compute/v2.1/servers/32b13842-6c63-4067-9fe4-1dbc1ab8b59d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:12:46.464689 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-437011658", "imageRef": "6e9e7df6-1876-46ae-8e0e-c3c926de5381", "flavorRef": "452"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:46.513350 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] validate_networks() for None {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:12:47.042065 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:12:47.042479 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:12:47.042954 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:12:47.043472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:12:47.043884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:12:47.055704 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:47.056540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:47.058052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:47.058846 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:47.076614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Getting quotas for project 12f46011b7ea49c19bdce6781051e356. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:12:47.080422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Getting quotas for user bd52d8de40c24efcbe17ab76c41fa2d9 and project 12f46011b7ea49c19bdce6781051e356. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:12:47.091505 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:12:47.093830 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e9e7df6-1876-46ae-8e0e-c3c926de5381',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:12:47.136925 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5eef50c8-f13c-4ffb-ab0c-32e8eda533ad tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676041 Nov 19 15:12:47.137559 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 498/1120] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:12:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:12:47.147185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8077402c-c5d7-4df2-a999-5590a891323c tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:47.147787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8077402c-c5d7-4df2-a999-5590a891323c tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:47.200770 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8077402c-c5d7-4df2-a999-5590a891323c tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:47.207290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8077402c-c5d7-4df2-a999-5590a891323c tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1214 microversion: 2.1 time: 0.063878 Nov 19 15:12:47.208522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 623/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:47 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:48.226098 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:48.228006 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:48.236991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:48.237939 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:48.238897 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:48.239499 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:48.349660 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:48.358018 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-068f8d2c-a535-427f-ab88-b6d99276a5a9 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1272 microversion: 2.1 time: 0.136493 Nov 19 15:12:48.358585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 499/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:48 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:49.376003 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:49.376615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:49.385142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:49.386147 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:49.387555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:49.388179 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:49.671387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:49.685988 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2ae01c8c-0e04-40c0-a55c-748fa4286c25 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.313537 Nov 19 15:12:49.705772 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 624/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:49 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:49.748590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-3e8d0b6c-fa8b-46ee-b661-40fa4a889c3e req-307c02fa-3ac0-4aaf-86d8-21312dad9835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981c7fa0-c831-440d-ad40-61b2e67a4a4d", "tag": "e493b4a7-dca9-4696-b796-400540758bdb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:49.751665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:49.751665 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:12:49.768093 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3e8d0b6c-fa8b-46ee-b661-40fa4a889c3e req-307c02fa-3ac0-4aaf-86d8-21312dad9835 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:49.768566 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3e8d0b6c-fa8b-46ee-b661-40fa4a889c3e req-307c02fa-3ac0-4aaf-86d8-21312dad9835 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:49.783357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-3e8d0b6c-fa8b-46ee-b661-40fa4a889c3e req-307c02fa-3ac0-4aaf-86d8-21312dad9835 service nova] Creating event network-changed:e493b4a7-dca9-4696-b796-400540758bdb for instance 981c7fa0-c831-440d-ad40-61b2e67a4a4d on hv-cinder-81757 Nov 19 15:12:49.795132 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-3e8d0b6c-fa8b-46ee-b661-40fa4a889c3e req-307c02fa-3ac0-4aaf-86d8-21312dad9835 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057309 Nov 19 15:12:49.796085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 500/1124] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:50.703406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:50.704023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:50.710564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:50.711019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:50.711809 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:50.712246 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:50.905705 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:50.916498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3c72b8e2-2fb4-4e0c-9838-cede377b37c4 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.215886 Nov 19 15:12:50.917933 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 625/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:50 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:51.935369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:51.936289 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:51.942718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:51.943472 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:51.944323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:51.944992 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:51.959754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:51.960890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:51.969094 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:51.969839 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:51.971036 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:51.971645 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:51.999345 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lazy-loading 'flavor' on Instance uuid 222bad07-b2dc-40bb-a888-a9d8c2924238 {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:12:52.090661 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e020b989-ab83-48e3-9329-2302199fd18f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "POST /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238/action" status: 202 len: 0 microversion: 2.1 time: 0.134659 Nov 19 15:12:52.091367 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 626/1126] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:12:51 2021] POST /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 15:12:52.099983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:52.101050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:52.110041 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:52.110855 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:52.111876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:52.112450 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:52.290466 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:52.310170 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5215428c-4fae-4abf-a2d2-d1ce4eaab26d tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.214156 Nov 19 15:12:52.313197 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 627/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:52 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:52.336881 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:52.348115 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7e573063-4000-4392-a53c-4ad961d752bf tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.417670 Nov 19 15:12:52.353211 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 501/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:51 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:53.330754 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:53.331362 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:53.338557 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:53.339336 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:53.340321 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:53.340977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:53.366058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:53.366808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:53.377569 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:53.378022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:53.378918 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:53.379362 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:53.539060 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:53.550262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-95111091-5c1e-425c-bfa0-e2c3a951a934 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.223219 Nov 19 15:12:53.552036 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 628/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:53 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:53.570721 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:53.592576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf0a6935-7e3b-40c4-9ed1-8f69d36d346d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.230710 Nov 19 15:12:53.594153 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 502/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:53 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:54.569858 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:54.571299 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:54.578801 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:54.579530 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:54.580547 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:54.581105 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:54.610247 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:54.610862 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:54.623451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:54.624307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:54.625392 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:54.626033 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:54.803845 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:54.816314 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-130caabb-973f-48fe-911e-617211058e35 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.206376 Nov 19 15:12:54.817236 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 503/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:54 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:54.869977 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:54.879795 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b9113d5b-b763-4174-9d73-03ee8455dbe7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.312813 Nov 19 15:12:54.881846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 629/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:54 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:55.177349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-e43194cd-a074-4788-b102-18e1a9d6078d req-6a75ed9f-7411-4e52-b80f-530096863406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981c7fa0-c831-440d-ad40-61b2e67a4a4d", "name": "network-vif-plugged", "status": "completed", "tag": "e493b4a7-dca9-4696-b796-400540758bdb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:55.178905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:55.178905 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:12:55.186356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-e43194cd-a074-4788-b102-18e1a9d6078d req-6a75ed9f-7411-4e52-b80f-530096863406 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:55.187051 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-e43194cd-a074-4788-b102-18e1a9d6078d req-6a75ed9f-7411-4e52-b80f-530096863406 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:55.199112 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-e43194cd-a074-4788-b102-18e1a9d6078d req-6a75ed9f-7411-4e52-b80f-530096863406 service nova] Creating event network-vif-plugged:e493b4a7-dca9-4696-b796-400540758bdb for instance 981c7fa0-c831-440d-ad40-61b2e67a4a4d on hv-cinder-81757 Nov 19 15:12:55.204557 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-e43194cd-a074-4788-b102-18e1a9d6078d req-6a75ed9f-7411-4e52-b80f-530096863406 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Nov 19 15:12:55.205437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 504/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:55.835045 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:55.835655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:55.843023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:55.843569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:55.844660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:55.845224 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:55.898510 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:55.909535 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:55.919285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:55.919744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:55.920581 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:55.921041 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:56.049670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:56.063833 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-95da0d74-4528-4723-800c-6dbd07d656f0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1314 microversion: 2.1 time: 0.232625 Nov 19 15:12:56.065196 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 630/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:55 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:56.162848 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:56.171073 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6419ab3f-e801-424c-b142-ed16516e7cd6 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.276542 Nov 19 15:12:56.176681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 505/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:55 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:57.082358 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:57.083953 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:57.093973 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.101570 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.103698 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.104145 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.197388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:57.198103 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:57.205491 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.206191 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.207144 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.207739 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.333601 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:57.347554 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cb82bbff-a06b-4576-bfb7-c01cce68bfa8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1463 microversion: 2.1 time: 0.268984 Nov 19 15:12:57.348378 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 631/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:57 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1463 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:57.414173 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:57.414654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:57.425589 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.426285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.427275 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.429020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.481190 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:12:57.573789 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:57.588276 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d60de21a-9723-42a0-865d-d091beb70947 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.398247 Nov 19 15:12:57.592638 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 506/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:57 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:57.637225 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f564095e-c13a-4fd0-bc7a-ab2e930f8f3d tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 204 len: 0 microversion: 2.1 time: 0.225640 Nov 19 15:12:57.641743 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 632/1138] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:12:57 2021] DELETE /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 15:12:57.646701 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:57.647335 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:57.653668 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.654121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.655527 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:57.655996 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:57.925454 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:57.936265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0eb2fc2a-71d2-4639-85a4-1a2c42992b13 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1469 microversion: 2.1 time: 0.292456 Nov 19 15:12:57.937931 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 507/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:57 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:58.611947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:58.613617 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:58.620949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:58.621655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:58.622703 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:58.623361 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:58.813317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:58.824991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-23439979-3372-4d41-890b-9b716c73e99b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.218084 Nov 19 15:12:58.835255 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 633/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:58 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:58.904934 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Action: 'create', calling method: .version_select at 0x7f37c73cfd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-940794978"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:58.919590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for project 65503588761e4489b784b977e0d1e639. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:12:58.926287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for user f5389b112cc643f580e70c1b8cfe5907 and project 65503588761e4489b784b977e0d1e639. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:12:58.954057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:58.954884 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:58.961321 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:58.961762 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:58.962564 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:58.962999 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:59.147273 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:12:59.152030 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for project 65503588761e4489b784b977e0d1e639. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:12:59.157886 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for user f5389b112cc643f580e70c1b8cfe5907 and project 65503588761e4489b784b977e0d1e639. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:12:59.170151 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b5d12072-89b5-4cde-bf64-041b2b63b2c0 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1469 microversion: 2.1 time: 0.219542 Nov 19 15:12:59.177071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d222087b-ff52-41ff-b155-620d5519cec7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.507200 Nov 19 15:12:59.182582 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 634/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:58 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:12:59.192811 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 508/1142] 10.222.0.20 () {60 vars in 1157 bytes} [Fri Nov 19 15:12:58 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:12:59.806267 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-11cb618d-53e6-4cae-9765-e23478e05b91 req-e19c04ce-0cba-4134-8f08-19b8a5dc2dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981c7fa0-c831-440d-ad40-61b2e67a4a4d", "name": "network-vif-deleted", "tag": "e493b4a7-dca9-4696-b796-400540758bdb"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:12:59.807905 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:12:59.807905 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:12:59.823544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-11cb618d-53e6-4cae-9765-e23478e05b91 req-e19c04ce-0cba-4134-8f08-19b8a5dc2dd1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:59.823998 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-11cb618d-53e6-4cae-9765-e23478e05b91 req-e19c04ce-0cba-4134-8f08-19b8a5dc2dd1 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:59.847792 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:12:59.851604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-11cb618d-53e6-4cae-9765-e23478e05b91 req-e19c04ce-0cba-4134-8f08-19b8a5dc2dd1 service nova] Creating event network-vif-deleted:e493b4a7-dca9-4696-b796-400540758bdb for instance 981c7fa0-c831-440d-ad40-61b2e67a4a4d on hv-cinder-81757 Nov 19 15:12:59.853827 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:12:59.856913 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-11cb618d-53e6-4cae-9765-e23478e05b91 req-e19c04ce-0cba-4134-8f08-19b8a5dc2dd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054802 Nov 19 15:12:59.868265 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:59.868781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 635/1143] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:12:59.871077 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:12:59.873855 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:12:59.876343 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:00.089792 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:00.097626 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f0dd6d80-866a-4cd9-93dd-d3fb4f25b0f7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.257628 Nov 19 15:13:00.098432 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 509/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:12:59 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:13:00.197752 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:00.198737 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:00.207385 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:00.207838 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:00.208917 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:00.209357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:00.248174 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:00.248636 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:00.249161 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.objects.instance [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lazy-loading 'fault' on Instance uuid 981c7fa0-c831-440d-ad40-61b2e67a4a4d {{(pid=116265) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 15:13:00.312381 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd52d8de40c24efcbe17ab76c41fa2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f46011b7ea49c19bdce6781051e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:00.326878 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b2509c98-5839-4e13-89b9-bb5636bc69c8 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 200 len: 1304 microversion: 2.1 time: 0.134326 Nov 19 15:13:00.334131 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 636/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:00 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:01.118380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:01.120030 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:01.131989 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:01.132446 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:01.134714 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:01.135301 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:01.344678 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:01.346254 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] [instance: 981c7fa0-c831-440d-ad40-61b2e67a4a4d] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:01.348765 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:01.354846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:01.355294 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:01.356089 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:01.356518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:01.360504 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f3e49560-46d8-4218-a78a-8f6cac4a1db9 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.247468 Nov 19 15:13:01.366129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 510/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:01 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:01.376929 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] HTTP exception thrown: Instance 981c7fa0-c831-440d-ad40-61b2e67a4a4d could not be found. Nov 19 15:13:01.377531 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] Returning 404 to user: Instance 981c7fa0-c831-440d-ad40-61b2e67a4a4d could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:13:01.378347 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-e9ae88d9-6272-47c2-b65c-30927bed8bd7 tempest-VolumesNegativeTest-1739745417 tempest-VolumesNegativeTest-1739745417-project] 10.222.0.20 "GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d" status: 404 len: 111 microversion: 2.1 time: 0.037374 Nov 19 15:13:01.378876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 637/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:01 2021] GET /compute/v2.1/servers/981c7fa0-c831-440d-ad40-61b2e67a4a4d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:13:02.386132 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:02.389547 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:02.397855 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:02.398307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:02.399104 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:02.399541 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:02.658110 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:02.681267 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d26a8cf4-d96a-4ce1-9c94-ab3935b4c0a3 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.299711 Nov 19 15:13:02.689073 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 511/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:02 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:03.699109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:03.699719 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:03.706471 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:03.706860 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:03.707657 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:03.708351 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:03.857110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:03.865458 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-a1b3b143-44c9-48f5-821c-fc744d251a8f tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.170513 Nov 19 15:13:03.866019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 638/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:03 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:04.883177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:04.884052 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:04.891629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:04.892177 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:04.893011 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:04.893548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:05.032642 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:05.040217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8963c534-d357-455f-b4f7-bc7a8ae65cdd tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.160660 Nov 19 15:13:05.050224 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 512/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:04 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:06.057518 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:06.058043 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:06.064162 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.064605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.065407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.065870 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.200722 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:06.208813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d64f083f-f9b2-4eaf-b0cc-0a51f574e653 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1511 microversion: 2.1 time: 0.154937 Nov 19 15:13:06.209406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 639/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:06 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:06.225169 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:06.225841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:06.232681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.233170 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.234001 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.234443 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.311199 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb0fcd31-a754-44c2-8118-38d5202e12be tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "POST /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238/action" status: 202 len: 0 microversion: 2.1 time: 0.089374 Nov 19 15:13:06.313356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 513/1152] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Nov 19 15:13:06 2021] POST /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:13:06.326138 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:06.327243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:06.337167 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.337948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.339387 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:06.340240 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:06.528487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:06.536625 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-42a8d2a8-5224-4718-bb80-eedca38af39b tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1519 microversion: 2.1 time: 0.217375 Nov 19 15:13:06.537544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 640/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:06 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:07.554949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:07.555518 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:07.561544 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:07.562074 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:07.562962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:07.563399 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:07.696017 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:07.704481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ce96b99d-b8d4-4b40-aa2b-3c1d54c8644c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.153656 Nov 19 15:13:07.705107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 514/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:07 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:08.722995 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:08.723605 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:08.729940 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:08.730301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:08.731066 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:08.731498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:08.868412 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:08.877671 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-01aa4516-c346-4c1b-96b9-8d5c81de1dc5 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.158214 Nov 19 15:13:08.878254 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 641/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:08 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:08.908356 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-6728bf27-0c79-4760-9359-5932fd1c599d req-92b46593-f7cb-45b8-9390-887dcde04f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "name": "network-vif-unplugged", "status": "completed", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:08.910083 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:13:08.910083 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:13:08.917840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6728bf27-0c79-4760-9359-5932fd1c599d req-92b46593-f7cb-45b8-9390-887dcde04f70 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:08.919183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6728bf27-0c79-4760-9359-5932fd1c599d req-92b46593-f7cb-45b8-9390-887dcde04f70 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:08.930254 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-6728bf27-0c79-4760-9359-5932fd1c599d req-92b46593-f7cb-45b8-9390-887dcde04f70 service nova] Creating event network-vif-unplugged:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:13:08.936109 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-6728bf27-0c79-4760-9359-5932fd1c599d req-92b46593-f7cb-45b8-9390-887dcde04f70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031493 Nov 19 15:13:08.937240 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 515/1156] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:13:09.895423 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:09.896209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:09.902943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:09.903400 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:09.904182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:09.904624 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:10.036828 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:10.044610 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-3ae4d213-502b-4636-af15-196f4a3f34d8 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.152840 Nov 19 15:13:10.045198 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 642/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:09 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:11.062526 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:11.063136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:11.069825 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:11.070270 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:11.071075 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:11.071511 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:11.213087 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:11.220621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b4b3616a-1d81-4767-878b-c9ef4afd3b36 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.162539 Nov 19 15:13:11.221214 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 516/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:11 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:12.237571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:12.238182 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:12.244395 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:12.244877 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:12.245658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:12.246130 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:12.380234 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:12.388442 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d2f467bb-af13-4e68-aa59-918740e1404e tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.154547 Nov 19 15:13:12.389026 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 643/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:12 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:13.405533 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:13.406071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:13.412852 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:13.413210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:13.413976 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:13.414405 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:13.546978 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:13.554221 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6510e2d2-2ade-4621-9862-f30bdf4b06ef tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.152586 Nov 19 15:13:13.554778 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 517/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:13 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:14.571238 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:14.572635 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:14.579569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:14.580019 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:14.580830 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:14.581261 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:14.716654 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:14.723880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d2bf6abd-f5c9-4a25-9f4f-56f685c127fb tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1577 microversion: 2.1 time: 0.156459 Nov 19 15:13:14.724426 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 644/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:14 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:15.741313 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:15.741913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:15.748162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:15.748604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:15.749413 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:15.749844 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:15.880249 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:15.887945 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-351ce819-11c8-4788-8104-4756b84b24a4 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1564 microversion: 2.1 time: 0.150313 Nov 19 15:13:15.888502 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 518/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:15 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:19.004550 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-012b070b-86c7-41a2-9bfe-addfe4634772 req-ef615aec-d346-42a7-ac7a-75d6faf8f515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "name": "network-vif-plugged", "status": "completed", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:19.006347 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:13:19.006347 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:13:19.014102 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-012b070b-86c7-41a2-9bfe-addfe4634772 req-ef615aec-d346-42a7-ac7a-75d6faf8f515 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:19.014540 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-012b070b-86c7-41a2-9bfe-addfe4634772 req-ef615aec-d346-42a7-ac7a-75d6faf8f515 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:19.025602 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-012b070b-86c7-41a2-9bfe-addfe4634772 req-ef615aec-d346-42a7-ac7a-75d6faf8f515 service nova] Creating event network-vif-plugged:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:13:19.033027 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-012b070b-86c7-41a2-9bfe-addfe4634772 req-ef615aec-d346-42a7-ac7a-75d6faf8f515 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Nov 19 15:13:19.033824 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 645/1163] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:13:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:13:19.111447 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2049622002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940794978", "security_groups": [{"name": "tempest-secgroup-smoke-417721389"}], "block_device_mapping_v2": [{"uuid": "eb1ec36e-ecef-4885-b136-9d876c2f866e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c592f38-b1dc-4d53-b93f-a1671b339d81"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:19.219025 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] validate_networks() for [('1c592f38-b1dc-4d53-b93f-a1671b339d81', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:13:19.577945 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:13:19.578402 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:13:19.578874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:13:19.579281 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:13:19.579685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:13:19.590014 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:19.590462 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:19.591280 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:19.591715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:19.609279 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:13:19.613663 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for user f5389b112cc643f580e70c1b8cfe5907 and project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:13:19.672036 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:13:19.674285 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb1ec36e-ecef-4885-b136-9d876c2f866e',volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:13:19.797215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2d0cadb2-e828-4550-9f6f-8fd44a688db5 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.689358 Nov 19 15:13:19.797866 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 519/1164] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:13:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:13:19.808159 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ba248968-ba9d-4c3e-87e3-b26e553e022e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:19.808900 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ba248968-ba9d-4c3e-87e3-b26e553e022e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:19.862502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ba248968-ba9d-4c3e-87e3-b26e553e022e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:19.869023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ba248968-ba9d-4c3e-87e3-b26e553e022e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1094 microversion: 2.1 time: 0.064782 Nov 19 15:13:19.869575 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 646/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:19 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:20.885715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:20.886722 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:20.893808 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:20.894347 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:20.895217 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:20.895742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:20.973066 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:20.980974 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4459757-1420-4714-aea5-f1d725bb4e1e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1210 microversion: 2.1 time: 0.098564 Nov 19 15:13:20.981888 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 520/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:20 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:21.998142 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:21.998919 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:22.006266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:22.006775 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:22.007690 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:22.008322 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:22.083614 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-a58f4976-9b0f-4250-b9e2-e68f776c436e req-4f6f26e2-b465-4761-b9cf-2984c0cd6ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f534c90-09f2-4218-b7b4-705333509372", "tag": "49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:22.087550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:13:22.087550 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:13:22.100147 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a58f4976-9b0f-4250-b9e2-e68f776c436e req-4f6f26e2-b465-4761-b9cf-2984c0cd6ca4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:22.101124 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a58f4976-9b0f-4250-b9e2-e68f776c436e req-4f6f26e2-b465-4761-b9cf-2984c0cd6ca4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:22.116983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-a58f4976-9b0f-4250-b9e2-e68f776c436e req-4f6f26e2-b465-4761-b9cf-2984c0cd6ca4 service nova] Creating event network-changed:49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc for instance 4f534c90-09f2-4218-b7b4-705333509372 on hv-cinder-81757 Nov 19 15:13:22.129624 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-a58f4976-9b0f-4250-b9e2-e68f776c436e req-4f6f26e2-b465-4761-b9cf-2984c0cd6ca4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047989 Nov 19 15:13:22.130230 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 521/1167] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:13:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:13:22.171386 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:22.179544 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-cfaa790b-72ad-472f-9f6b-7cb6c4424dec tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.185156 Nov 19 15:13:22.180112 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 647/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:21 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:23.198358 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:23.199679 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:23.205652 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:23.206096 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:23.206875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:23.207309 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:23.375437 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:23.382674 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2183f22a-9834-4137-8834-d032cbb407fb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.188725 Nov 19 15:13:23.383225 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 522/1169] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:23 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:24.400287 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:24.400916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:24.407791 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:24.408232 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:24.409044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:24.409478 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:24.539407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:24.546651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b20cc5aa-5e7c-4ffa-ae29-12f24a40bfcc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.149982 Nov 19 15:13:24.547209 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 648/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:24 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:25.563857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:25.564463 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:25.570705 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:25.571162 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:25.571938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:25.572377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:25.703510 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:25.711024 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-68244b30-062f-49f7-8d05-074846120346 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.150818 Nov 19 15:13:25.711577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 523/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:25 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:26.728323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:26.728986 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:26.735290 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:26.735843 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:26.736626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:26.737129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:27.073004 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:27.080922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ce26d9a8-f9e4-434e-9c2f-299042c67364 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.356296 Nov 19 15:13:27.081476 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 649/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:26 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:28.097898 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:28.098520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:28.104494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:28.105627 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:28.106501 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:28.106941 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:28.238938 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:28.246325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17a2cddd-c432-4a2d-a454-870240efb745 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.152059 Nov 19 15:13:28.246884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 524/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:28 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:29.263439 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:29.264039 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:29.270085 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:29.270569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:29.271349 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:29.271812 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:29.405327 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:29.412553 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-64dd9dbb-29ad-4d8a-b0d8-c013f8e60ecb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.153503 Nov 19 15:13:29.413149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 650/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:29 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:30.430229 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:30.430860 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:30.437131 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:30.437577 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:30.438349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:30.438782 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:30.571330 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:30.578524 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6180f020-2077-4d23-9ab7-610b15fe3212 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.151990 Nov 19 15:13:30.579079 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 525/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:30 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:31.595274 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:31.595887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:31.602272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:31.602899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:31.603675 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:31.604257 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:31.738302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:31.746930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-740f3915-f4ec-41d8-807e-da5c4d3ea16c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.154066 Nov 19 15:13:31.747168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 651/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:31 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:32.763899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:32.764438 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:32.770839 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:32.771287 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:32.772055 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:32.772485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:32.902422 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:32.909689 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3fa8c653-70cd-4a71-8da2-a3924f83f481 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.150151 Nov 19 15:13:32.910251 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 526/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:32 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:33.085403 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-289434ce-7e0b-4b8a-a65b-ddc7e54494fc req-95481b65-1795-4f58-9a74-df8aa5d7968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f534c90-09f2-4218-b7b4-705333509372", "name": "network-vif-plugged", "status": "completed", "tag": "49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:33.087010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:13:33.087010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:13:33.094670 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-289434ce-7e0b-4b8a-a65b-ddc7e54494fc req-95481b65-1795-4f58-9a74-df8aa5d7968a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:33.095123 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-289434ce-7e0b-4b8a-a65b-ddc7e54494fc req-95481b65-1795-4f58-9a74-df8aa5d7968a service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:33.106789 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-289434ce-7e0b-4b8a-a65b-ddc7e54494fc req-95481b65-1795-4f58-9a74-df8aa5d7968a service nova] Creating event network-vif-plugged:49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc for instance 4f534c90-09f2-4218-b7b4-705333509372 on hv-cinder-81757 Nov 19 15:13:33.111665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-289434ce-7e0b-4b8a-a65b-ddc7e54494fc req-95481b65-1795-4f58-9a74-df8aa5d7968a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 Nov 19 15:13:33.112244 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 652/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:13:33.926195 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:33.926806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:33.933025 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:33.933563 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:33.934349 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:33.934790 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:34.067420 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:34.075389 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-afefa070-6b4c-46ee-9306-2d9c35783a3f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1265 microversion: 2.1 time: 0.152906 Nov 19 15:13:34.075946 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 527/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:33 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:35.094248 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:35.094947 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:35.101106 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:35.101561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:35.102346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:35.102799 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:35.233745 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:35.240958 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-26002368-f75d-4613-9384-b2a46297311b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1453 microversion: 2.1 time: 0.151943 Nov 19 15:13:35.241519 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 653/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:35 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:35.256972 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:13:35.257587 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:13:35.264509 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:35.265000 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:35.265775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:35.266207 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:35.396292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:13:35.404307 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-99286c54-45cb-4f53-9962-68d19d44f9db tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1453 microversion: 2.1 time: 0.150936 Nov 19 15:13:35.404900 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 528/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:13:35 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:13:37.076168 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-28913995-3a6a-49d3-bb10-955b157816dd req-a37416c4-c281-4b49-9fd7-6a61221a8029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f534c90-09f2-4218-b7b4-705333509372", "tag": "49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:13:37.077717 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:13:37.077717 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:13:37.086262 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-28913995-3a6a-49d3-bb10-955b157816dd req-a37416c4-c281-4b49-9fd7-6a61221a8029 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:13:37.086709 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-28913995-3a6a-49d3-bb10-955b157816dd req-a37416c4-c281-4b49-9fd7-6a61221a8029 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:13:37.098114 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-28913995-3a6a-49d3-bb10-955b157816dd req-a37416c4-c281-4b49-9fd7-6a61221a8029 service nova] Creating event network-changed:49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc for instance 4f534c90-09f2-4218-b7b4-705333509372 on hv-cinder-81757 Nov 19 15:13:37.103029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-28913995-3a6a-49d3-bb10-955b157816dd req-a37416c4-c281-4b49-9fd7-6a61221a8029 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031300 Nov 19 15:13:37.103626 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 654/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:13:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:13:59.164693 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:13:59.165555 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:13:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:14:35.247896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:35.248458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:14:35.253465 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-57cd864e-b925-48b8-ad63-8c30f7dc4bf0 req-b37b98a4-acf4-45df-b796-ddbfac7dfee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:14:35.254743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:35.254943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:14:35.254943 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:14:35.255332 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:35.256576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:35.256576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:35.262781 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-57cd864e-b925-48b8-ad63-8c30f7dc4bf0 req-b37b98a4-acf4-45df-b796-ddbfac7dfee9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:35.263222 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-57cd864e-b925-48b8-ad63-8c30f7dc4bf0 req-b37b98a4-acf4-45df-b796-ddbfac7dfee9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:35.273690 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-57cd864e-b925-48b8-ad63-8c30f7dc4bf0 req-b37b98a4-acf4-45df-b796-ddbfac7dfee9 service nova] Creating event network-changed:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:14:35.279177 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-57cd864e-b925-48b8-ad63-8c30f7dc4bf0 req-b37b98a4-acf4-45df-b796-ddbfac7dfee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036947 Nov 19 15:14:35.280125 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 655/1183] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:14:35.285458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:14:35.367292 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac1b817e-c8cc-4516-b436-613f52cd8264 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "DELETE /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 204 len: 0 microversion: 2.1 time: 0.127537 Nov 19 15:14:35.368121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 529/1184] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:14:35 2021] DELETE /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:14:35.378363 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:35.379065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:14:35.385846 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:35.386414 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:35.387563 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:35.388201 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:35.646520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:14:35.654712 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-9cc42603-e69f-4b23-91ac-d912a201eff7 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1570 microversion: 2.1 time: 0.281284 Nov 19 15:14:35.655503 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 656/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:14:35 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:14:36.672583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:36.673305 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:14:36.679774 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:36.680215 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:36.681023 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:36.681474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:36.862732 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:14:36.870096 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf3956da-a053-434c-9876-b7c456c1b4e2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1451 microversion: 2.1 time: 0.201607 Nov 19 15:14:36.870663 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 530/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:14:36 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1451 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:14:37.702052 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-104ff248-6efe-4574-ab49-7ff9185e121a req-5d951fb1-0b91-4733-914f-35871445f390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bad07-b2dc-40bb-a888-a9d8c2924238", "name": "network-vif-deleted", "tag": "f027497f-023f-4332-a537-0bf7c3e6a081"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:14:37.703647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:14:37.703647 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:14:37.711420 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-104ff248-6efe-4574-ab49-7ff9185e121a req-5d951fb1-0b91-4733-914f-35871445f390 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:37.711888 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-104ff248-6efe-4574-ab49-7ff9185e121a req-5d951fb1-0b91-4733-914f-35871445f390 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:37.723428 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-104ff248-6efe-4574-ab49-7ff9185e121a req-5d951fb1-0b91-4733-914f-35871445f390 service nova] Creating event network-vif-deleted:f027497f-023f-4332-a537-0bf7c3e6a081 for instance 222bad07-b2dc-40bb-a888-a9d8c2924238 on hv-cinder-81757 Nov 19 15:14:37.728317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-104ff248-6efe-4574-ab49-7ff9185e121a req-5d951fb1-0b91-4733-914f-35871445f390 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 Nov 19 15:14:37.728927 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 657/1187] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:14:37.887949 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:37.888481 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:14:37.894730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:37.895182 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:37.895957 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:37.896391 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:37.957350 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000d0cea98e84f78a913d6cf76136092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b1a546d19f4c95ac7e9af520d72381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:14:37.964909 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f4756aa-135c-4e73-969d-6e8cae20dd8c tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 200 len: 1220 microversion: 2.1 time: 0.081426 Nov 19 15:14:37.967049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 531/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:14:37 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:14:38.982615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:38.983302 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] [instance: 222bad07-b2dc-40bb-a888-a9d8c2924238] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:14:38.989569 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:38.990023 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:38.990804 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:14:38.991247 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:14:39.004092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] HTTP exception thrown: Instance 222bad07-b2dc-40bb-a888-a9d8c2924238 could not be found. Nov 19 15:14:39.004677 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Returning 404 to user: Instance 222bad07-b2dc-40bb-a888-a9d8c2924238 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:14:39.005507 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-43a70cd4-ba6a-4b1b-a2b9-7dcb881565f2 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238" status: 404 len: 111 microversion: 2.1 time: 0.027446 Nov 19 15:14:39.006020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 658/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:14:38 2021] GET /compute/v2.1/servers/222bad07-b2dc-40bb-a888-a9d8c2924238 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:14:39.158882 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f0b07559-dee0-4787-a306-2cf0ba921a65 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] Calling method '.version_select at 0x7f37c74b8f70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:14:39.176715 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f0b07559-dee0-4787-a306-2cf0ba921a65 tempest-TestShelveInstance-1315738625 tempest-TestShelveInstance-1315738625-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1500830650" status: 202 len: 0 microversion: 2.1 time: 0.021423 Nov 19 15:14:39.177325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 532/1190] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Nov 19 15:14:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1500830650 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:15:31.739914 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:15:31.740556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:15:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:15:34.880627 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:34.881273 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:34.887338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:34.887783 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:34.888548 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:34.889773 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:34.913684 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:15:34.985467 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-89264ffd-ed27-4b41-ae9e-53cfca52e83c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 204 len: 0 microversion: 2.1 time: 0.108289 Nov 19 15:15:34.986058 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 659/1191] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:15:34 2021] DELETE /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:15:34.993920 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:34.994529 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:35.002506 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:35.002956 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:35.003738 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:35.004175 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:35.134286 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:35.141919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8a09d7ea-c929-44cc-9ff6-3a840e8b0a48 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1578 microversion: 2.1 time: 0.151737 Nov 19 15:15:35.142467 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 533/1192] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:34 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:15:36.160329 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:36.161099 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:36.168484 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:36.168960 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:36.169746 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:36.170185 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:36.300560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:36.307803 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f00a054e-f3f0-4277-8129-c01c336543a7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1578 microversion: 2.1 time: 0.151516 Nov 19 15:15:36.308364 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 660/1193] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:36 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:37.325841 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:37.327058 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:37.335028 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:37.335508 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:37.336342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:37.337100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:37.429488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:37.437519 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0bc70cb4-148c-4634-b305-67b424b1767a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 200 len: 1511 microversion: 2.1 time: 0.115720 Nov 19 15:15:37.438096 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 534/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:37 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:37.757596 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-e99c83a7-9afd-41fd-806a-fafdf949626c req-3e40843d-47d0-4b9d-accb-cf1457450c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f534c90-09f2-4218-b7b4-705333509372", "name": "network-vif-deleted", "tag": "49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:15:37.759417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:15:37.759417 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:15:37.767013 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e99c83a7-9afd-41fd-806a-fafdf949626c req-3e40843d-47d0-4b9d-accb-cf1457450c5b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:37.767457 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-e99c83a7-9afd-41fd-806a-fafdf949626c req-3e40843d-47d0-4b9d-accb-cf1457450c5b service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:37.778945 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-e99c83a7-9afd-41fd-806a-fafdf949626c req-3e40843d-47d0-4b9d-accb-cf1457450c5b service nova] Creating event network-vif-deleted:49cc9bc1-bcfe-4ce8-b2a7-027e148bd6dc for instance 4f534c90-09f2-4218-b7b4-705333509372 on hv-cinder-81757 Nov 19 15:15:37.784543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-e99c83a7-9afd-41fd-806a-fafdf949626c req-3e40843d-47d0-4b9d-accb-cf1457450c5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171240 Nov 19 15:15:37.785166 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 661/1195] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:15:38.454984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:38.455726 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:38.462803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:38.463341 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:38.464237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:38.464770 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:38.481398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] HTTP exception thrown: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. Nov 19 15:15:38.482090 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Returning 404 to user: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:15:38.483085 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af1adf68-13cd-41b4-b924-5a9ddb7ebfdb tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 404 len: 111 microversion: 2.1 time: 0.032366 Nov 19 15:15:38.483625 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 535/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:38 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:15:38.580337 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-332620640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940794978", "security_groups": [{"name": "tempest-secgroup-smoke-417721389"}], "block_device_mapping_v2": [{"uuid": "eb1ec36e-ecef-4885-b136-9d876c2f866e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c592f38-b1dc-4d53-b93f-a1671b339d81"}]}} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:15:38.698104 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.network.neutron [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] validate_networks() for [('1c592f38-b1dc-4d53-b93f-a1671b339d81', None, None, None, None, None)] {{(pid=116265) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:15:39.106512 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:15:39.107119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image limits 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:15:39.107407 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:15:39.108653 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image pref 0:0:0 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:15:39.109204 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.virt.hardware [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116265) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:15:39.117669 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:39.118121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:39.118950 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:39.119390 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:39.136346 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:15:39.140623 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.quota [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for user f5389b112cc643f580e70c1b8cfe5907 and project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116265) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:15:39.195813 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Going to run 1 instances... {{(pid=116265) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:15:39.198133 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb1ec36e-ecef-4885-b136-9d876c2f866e',volume_size=None,volume_type=None)] {{(pid=116265) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:15:39.322914 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-d9b8339e-d42f-4226-b0fc-389c36a675d7 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747410 Nov 19 15:15:39.323552 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 662/1197] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:15:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:15:39.333585 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-46367e67-ee71-42a9-a595-26deaf26ee33 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:39.334192 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-46367e67-ee71-42a9-a595-26deaf26ee33 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:39.387256 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-46367e67-ee71-42a9-a595-26deaf26ee33 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:39.394163 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-46367e67-ee71-42a9-a595-26deaf26ee33 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1093 microversion: 2.1 time: 0.064415 Nov 19 15:15:39.394727 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 536/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:39 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:40.411305 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ed989585-9b62-45b0-a40e-24003f051baf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:40.411909 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ed989585-9b62-45b0-a40e-24003f051baf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:40.466664 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ed989585-9b62-45b0-a40e-24003f051baf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:40.473271 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ed989585-9b62-45b0-a40e-24003f051baf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1093 microversion: 2.1 time: 0.066116 Nov 19 15:15:40.473852 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 663/1199] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:40 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:41.489847 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:41.490448 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:41.497613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:41.498623 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:41.499409 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:41.499842 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:41.556654 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:41.564408 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7c2584b5-4be9-4554-8c4c-98d981389515 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1143 microversion: 2.1 time: 0.078240 Nov 19 15:15:41.564984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 537/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:41 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1143 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:42.581804 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:42.582500 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:42.589266 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:42.589790 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:42.590667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:42.591272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:42.653735 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:42.662065 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-96aaf7c5-7b62-4902-84cd-76d007b56a74 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1209 microversion: 2.1 time: 0.084831 Nov 19 15:15:42.662937 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 664/1201] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:42 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:43.683806 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:43.685095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:43.691991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:43.692600 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:43.693451 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:43.694103 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:44.018057 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-99c6e7a5-dfa3-40be-9687-2d842dfd44c0 req-a45f371c-2093-40d8-949c-a18e26ddaaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf3eece-d64c-4bf3-83bf-563ec88864ba", "tag": "955c8b76-5a6a-4692-b466-8c89094073a7"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:15:44.021928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:15:44.021928 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:15:44.040777 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-99c6e7a5-dfa3-40be-9687-2d842dfd44c0 req-a45f371c-2093-40d8-949c-a18e26ddaaca service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:44.041254 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-99c6e7a5-dfa3-40be-9687-2d842dfd44c0 req-a45f371c-2093-40d8-949c-a18e26ddaaca service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:44.061149 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-99c6e7a5-dfa3-40be-9687-2d842dfd44c0 req-a45f371c-2093-40d8-949c-a18e26ddaaca service nova] Creating event network-changed:955c8b76-5a6a-4692-b466-8c89094073a7 for instance eaf3eece-d64c-4bf3-83bf-563ec88864ba on hv-cinder-81757 Nov 19 15:15:44.069309 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-99c6e7a5-dfa3-40be-9687-2d842dfd44c0 req-a45f371c-2093-40d8-949c-a18e26ddaaca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055341 Nov 19 15:15:44.070842 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 665/1202] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:15:44.139128 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:44.146901 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5f3312b8-be8b-4627-9278-84c42423e7df tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.471218 Nov 19 15:15:44.147482 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 538/1203] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:43 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:45.165357 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:45.166020 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:45.172402 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:45.172890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:45.173717 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:45.174187 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:45.304253 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:45.312110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-75546b34-6b8e-4800-87a8-006766ec1a92 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.151356 Nov 19 15:15:45.312665 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 666/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:45 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:15:46.328875 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:46.329488 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:46.336155 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:46.336604 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:46.337413 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:46.337854 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:46.469072 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:46.476257 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-40a137f8-b88d-4b6c-ac45-d4949b111c79 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.151388 Nov 19 15:15:46.476840 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 539/1205] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:46 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:47.492930 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:47.493520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:47.500406 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:47.500880 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:47.501658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:47.502092 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:47.634655 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:47.642697 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f89b7af8-da6f-49c2-b55b-2de02f7a526e tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.153509 Nov 19 15:15:47.643250 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 667/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:47 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:48.659742 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:48.660369 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:48.666621 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:48.667100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:48.667878 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:48.668310 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:48.802209 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:48.809629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85635b33-2076-4365-8f39-e31b085bf9e6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.153527 Nov 19 15:15:48.810178 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 540/1207] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:48 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:15:49.825687 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:49.827331 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:49.833836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:49.834281 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:49.835048 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:49.835479 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:49.963230 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:49.970516 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-549c0835-f9d7-447d-86f0-b73af8bff86f tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.148499 Nov 19 15:15:49.971094 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 668/1208] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:49 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 15:15:50.987357 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:50.987919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:50.994047 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:50.994493 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:50.995274 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:50.995709 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:51.126132 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:51.133546 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19d10399-9a72-4a29-ae8c-768bef7c2266 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.150255 Nov 19 15:15:51.134103 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 541/1209] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:50 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:52.150602 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:52.151207 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:52.158077 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:52.158520 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:52.159301 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:52.159728 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:52.291010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:52.298730 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-5df9af0f-42a1-4f05-959b-4cb65013e4aa tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.151796 Nov 19 15:15:52.299298 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 669/1210] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:52 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:53.315786 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:53.316397 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:53.322669 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:53.323118 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:53.323899 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:53.324339 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:53.458761 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:53.465851 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fdbfb411-2586-4d42-9706-cf44aa6b45cc tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.153727 Nov 19 15:15:53.466410 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 542/1211] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:53 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:53.765853 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-2761ba5b-ab4d-4dd1-bab9-44e4694f5cda req-660717b3-91a2-4fd4-bfeb-9f6866ba2466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf3eece-d64c-4bf3-83bf-563ec88864ba", "name": "network-vif-plugged", "status": "completed", "tag": "955c8b76-5a6a-4692-b466-8c89094073a7"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:15:53.767416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:15:53.767416 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:15:53.774366 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-2761ba5b-ab4d-4dd1-bab9-44e4694f5cda req-660717b3-91a2-4fd4-bfeb-9f6866ba2466 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:53.774808 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-2761ba5b-ab4d-4dd1-bab9-44e4694f5cda req-660717b3-91a2-4fd4-bfeb-9f6866ba2466 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:53.788517 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-2761ba5b-ab4d-4dd1-bab9-44e4694f5cda req-660717b3-91a2-4fd4-bfeb-9f6866ba2466 service nova] Creating event network-vif-plugged:955c8b76-5a6a-4692-b466-8c89094073a7 for instance eaf3eece-d64c-4bf3-83bf-563ec88864ba on hv-cinder-81757 Nov 19 15:15:53.791571 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-2761ba5b-ab4d-4dd1-bab9-44e4694f5cda req-660717b3-91a2-4fd4-bfeb-9f6866ba2466 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089972 Nov 19 15:15:53.792141 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 670/1212] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:15:54.482413 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:54.483169 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:54.489323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:54.489776 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:54.490548 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:54.490983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:54.619696 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:54.627540 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7af905ee-d195-4cdc-9f82-71eeae36e0c6 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1264 microversion: 2.1 time: 0.148891 Nov 19 15:15:54.628092 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 543/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:54 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:55.645765 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:55.646463 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:55.652506 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:55.652983 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:55.653753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:55.654831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:55.789472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:55.796878 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dd0ef78b-b27d-429f-9c1c-2ded1bc0c57d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1452 microversion: 2.1 time: 0.155541 Nov 19 15:15:55.797436 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 671/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:55 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:55.813067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:15:55.813676 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:15:55.819803 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:55.820252 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:55.821086 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:55.821526 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:55.953458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:15:55.960967 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-503fc092-9de6-4baa-94bd-b852eed56dcd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1452 microversion: 2.1 time: 0.152062 Nov 19 15:15:55.961537 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 544/1215] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:15:55 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:15:57.533913 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-ef6cfa95-2ff5-444a-aad6-8a12a74dc858 req-2455bd74-d245-4cfd-8010-10c59fdd9aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf3eece-d64c-4bf3-83bf-563ec88864ba", "tag": "955c8b76-5a6a-4692-b466-8c89094073a7"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:15:57.535470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:15:57.535470 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:15:57.542949 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-ef6cfa95-2ff5-444a-aad6-8a12a74dc858 req-2455bd74-d245-4cfd-8010-10c59fdd9aa5 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:15:57.543391 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-ef6cfa95-2ff5-444a-aad6-8a12a74dc858 req-2455bd74-d245-4cfd-8010-10c59fdd9aa5 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:15:57.554807 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-ef6cfa95-2ff5-444a-aad6-8a12a74dc858 req-2455bd74-d245-4cfd-8010-10c59fdd9aa5 service nova] Creating event network-changed:955c8b76-5a6a-4692-b466-8c89094073a7 for instance eaf3eece-d64c-4bf3-83bf-563ec88864ba on hv-cinder-81757 Nov 19 15:15:57.559556 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-ef6cfa95-2ff5-444a-aad6-8a12a74dc858 req-2455bd74-d245-4cfd-8010-10c59fdd9aa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030459 Nov 19 15:15:57.560543 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 672/1216] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:17:28.165718 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:17:28.166325 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:17:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:17:45.301010 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1297579311", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940794978", "security_groups": [{"name": "tempest-secgroup-smoke-417721389"}], "block_device_mapping_v2": [{"uuid": "72354bb5-d09f-4407-ab26-5a18719b6ad9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c592f38-b1dc-4d53-b93f-a1671b339d81"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:17:45.406044 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] validate_networks() for [('1c592f38-b1dc-4d53-b93f-a1671b339d81', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 15:17:45.845202 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 15:17:45.845631 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 15:17:45.846107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 15:17:45.846520 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 15:17:45.846964 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 15:17:45.855438 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:45.855890 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:45.856710 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:45.857196 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:45.873984 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 15:17:45.878237 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Getting quotas for user f5389b112cc643f580e70c1b8cfe5907 and project 65503588761e4489b784b977e0d1e639. Resources: {'instances', 'ram', 'cores'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 15:17:45.933067 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 15:17:45.935176 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72354bb5-d09f-4407-ab26-5a18719b6ad9',volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 15:17:46.054857 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d1990b39-9659-4c0b-9101-a56b76d12335 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758894 Nov 19 15:17:46.055494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 545/1217] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Nov 19 15:17:45 2021] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 15:17:46.064382 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc5f6536-855f-42ad-a538-584bfd5e9f06] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 19 15:17:46.068857 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-b316ffeb-87d2-4b4a-9ead-c683097decd3 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:46.069749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-b316ffeb-87d2-4b4a-9ead-c683097decd3 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:46.124651 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-b316ffeb-87d2-4b4a-9ead-c683097decd3 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:46.131451 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-b316ffeb-87d2-4b4a-9ead-c683097decd3 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1094 microversion: 2.1 time: 0.069603 Nov 19 15:17:46.132010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 673/1218] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:46 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:47.149406 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:47.150359 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:47.157820 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:47.158280 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:47.159070 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:47.159509 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:47.535447 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:47.543098 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba085354-32b3-4713-ac2b-4d1403ca9e31 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1210 microversion: 2.1 time: 0.397965 Nov 19 15:17:47.543858 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 546/1219] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:47 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1210 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:48.560432 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:48.561050 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:48.582727 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:48.583179 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:48.583967 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:48.584399 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:48.591660 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc5f6536-855f-42ad-a538-584bfd5e9f06] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44394. Nov 19 15:17:48.643494 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-dca40b55-247d-4fce-b9cb-e095d911a361 req-871ae4d4-45c8-48f2-b876-575de98c4fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fba89b-1045-4d8d-8177-e2a2f04c8bd4", "tag": "8e2d5f4b-1acd-48bb-94e3-462529ef1bbb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:17:48.645790 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:17:48.645790 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:17:48.656987 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-dca40b55-247d-4fce-b9cb-e095d911a361 req-871ae4d4-45c8-48f2-b876-575de98c4fb4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:48.658416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-dca40b55-247d-4fce-b9cb-e095d911a361 req-871ae4d4-45c8-48f2-b876-575de98c4fb4 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:48.672107 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-dca40b55-247d-4fce-b9cb-e095d911a361 req-871ae4d4-45c8-48f2-b876-575de98c4fb4 service nova] Creating event network-changed:8e2d5f4b-1acd-48bb-94e3-462529ef1bbb for instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 on hv-cinder-81757 Nov 19 15:17:48.678069 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-dca40b55-247d-4fce-b9cb-e095d911a361 req-871ae4d4-45c8-48f2-b876-575de98c4fb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038417 Nov 19 15:17:48.679736 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 547/1220] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:17:48.773847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:48.784764 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1c66ccc8-80ee-43d9-b7e9-3ab456e17363 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.227791 Nov 19 15:17:48.785739 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 674/1221] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:48 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:49.804027 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:49.804652 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:49.810622 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:49.811074 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:49.812567 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:49.813049 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:49.941618 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:49.948785 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e3f2c07-e387-44d0-bf38-3db3b13bfb58 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.149371 Nov 19 15:17:49.949373 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 548/1222] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:49 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:50.965985 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:50.966527 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:50.972887 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:50.973338 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:50.974111 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:50.974551 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:51.102498 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:51.110916 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-2f82eb50-609f-4996-9c69-b2f76ccec582 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.148729 Nov 19 15:17:51.111487 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 675/1223] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:50 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:52.127613 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:52.128223 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:52.136543 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:52.137022 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:52.137810 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:52.138244 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:52.279713 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:52.288461 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-43b3ac9a-5213-47e6-b3a7-b7e17c478fc1 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.164879 Nov 19 15:17:52.289068 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 549/1224] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:52 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:53.305356 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:53.305957 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:53.312243 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:53.312683 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:53.313477 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:53.313912 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:53.441285 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:53.448314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1e419ec4-97e6-474e-ba29-38a9c4591211 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.146609 Nov 19 15:17:53.448876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 676/1225] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:53 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:54.465005 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:54.465620 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:54.472457 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:54.472952 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:54.473740 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:54.474183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:54.605744 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:54.613571 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1911ab30-d13c-47af-8d4b-5f518c608f38 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.152342 Nov 19 15:17:54.614122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 550/1226] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:54 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:55.629728 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:55.630323 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:55.636587 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:55.637067 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:55.637847 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:55.638280 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:55.770109 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:55.777350 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-04403d04-b919-446b-8dce-38165e53c67a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.151260 Nov 19 15:17:55.777890 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 677/1227] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:55 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:56.793775 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:56.794439 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:56.800983 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:56.801432 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:56.802210 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:56.809843 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:56.947418 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:56.955519 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dad39510-17e4-46ff-a8c9-e34e56104836 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.165153 Nov 19 15:17:56.956071 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 551/1228] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:56 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:57.972667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:57.973308 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:57.979561 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:57.980009 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:57.980785 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:57.981317 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:58.109667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:58.116922 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-ea76e0e5-f5aa-456a-a83f-7087f9a5c9ad tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.147860 Nov 19 15:17:58.117486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 678/1229] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:57 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:17:59.194388 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:17:59.194999 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:17:59.200892 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:59.201348 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:59.202151 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:17:59.202578 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:17:59.330627 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:17:59.337853 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-38e6447a-3fbf-4cc7-8d68-236582a21e40 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.208241 Nov 19 15:17:59.338416 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 552/1230] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:17:59 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:18:00.277931 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [req-4e313140-901c-4330-87ee-5891f0ce83aa req-b6ecb6e5-a6f6-45ab-8161-661877560d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fba89b-1045-4d8d-8177-e2a2f04c8bd4", "name": "network-vif-plugged", "status": "completed", "tag": "8e2d5f4b-1acd-48bb-94e3-462529ef1bbb"}]} {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:18:00.279534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:18:00.279534 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: warnings.warn(msg) Nov 19 15:18:00.287815 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-4e313140-901c-4330-87ee-5891f0ce83aa req-b6ecb6e5-a6f6-45ab-8161-661877560d59 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:00.288316 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [req-4e313140-901c-4330-87ee-5891f0ce83aa req-b6ecb6e5-a6f6-45ab-8161-661877560d59 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:00.301673 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.compute.server_external_events [req-4e313140-901c-4330-87ee-5891f0ce83aa req-b6ecb6e5-a6f6-45ab-8161-661877560d59 service nova] Creating event network-vif-plugged:8e2d5f4b-1acd-48bb-94e3-462529ef1bbb for instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 on hv-cinder-81757 Nov 19 15:18:00.306732 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [req-4e313140-901c-4330-87ee-5891f0ce83aa req-b6ecb6e5-a6f6-45ab-8161-661877560d59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Nov 19 15:18:00.307615 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 679/1231] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:18:00.355442 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:18:00.356048 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:18:00.363227 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:00.363675 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:00.364453 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:00.364923 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:00.507884 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:18:00.515479 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e667216e-8ea7-428a-aa48-3d4b8be34308 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.163839 Nov 19 15:18:00.516043 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 553/1232] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:18:00 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:18:01.532862 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:18:01.533559 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:18:01.539753 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:01.540203 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:01.541029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:01.541461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:01.688011 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:18:01.696312 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-956536c9-ecd6-4481-836d-aa40b7500e4a tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1265 microversion: 2.1 time: 0.168131 Nov 19 15:18:01.696902 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 680/1233] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:18:01 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:18:02.713476 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:18:02.714095 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:18:02.721103 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:02.721555 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:02.722380 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:02.722826 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:02.854146 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:18:02.861730 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d80d14e-72b3-4a53-b386-daebbd4792ca tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1452 microversion: 2.1 time: 0.151971 Nov 19 15:18:02.862294 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 554/1234] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:18:02 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:18:02.878629 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:18:02.879239 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:18:02.885461 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:02.885914 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:02.886694 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:02.887129 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:03.016189 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:18:03.023372 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-1cf73a04-478b-46a2-b4b3-ebc353c83ac0 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1452 microversion: 2.1 time: 0.148367 Nov 19 15:18:03.023948 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 681/1235] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:18:02 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:18:04.844957 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-72539f05-df72-483a-ac6f-c36f877b09f1 req-5dda88c8-2d14-4322-b3f0-425f02052de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fba89b-1045-4d8d-8177-e2a2f04c8bd4", "tag": "8e2d5f4b-1acd-48bb-94e3-462529ef1bbb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:18:04.846474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:18:04.846474 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:18:04.861611 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-72539f05-df72-483a-ac6f-c36f877b09f1 req-5dda88c8-2d14-4322-b3f0-425f02052de9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:18:04.862062 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-72539f05-df72-483a-ac6f-c36f877b09f1 req-5dda88c8-2d14-4322-b3f0-425f02052de9 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:18:04.874962 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-72539f05-df72-483a-ac6f-c36f877b09f1 req-5dda88c8-2d14-4322-b3f0-425f02052de9 service nova] Creating event network-changed:8e2d5f4b-1acd-48bb-94e3-462529ef1bbb for instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 on hv-cinder-81757 Nov 19 15:18:04.880278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-72539f05-df72-483a-ac6f-c36f877b09f1 req-5dda88c8-2d14-4322-b3f0-425f02052de9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094847 Nov 19 15:18:04.881288 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 555/1236] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:18:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:18:51.757637 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:18:51.758110 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:18:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:18:59.188923 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:18:59.189631 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:18:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:19:44.567035 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:44.567696 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:44.570269 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-faa7f454-f97f-4c60-8a6f-185fe850c24c req-f3c4da11-e61b-42ca-8da6-a6ce6834a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fba89b-1045-4d8d-8177-e2a2f04c8bd4", "tag": "8e2d5f4b-1acd-48bb-94e3-462529ef1bbb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:19:44.571874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:19:44.571874 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:19:44.573835 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:44.574472 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:44.575397 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:44.575836 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:44.580142 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-faa7f454-f97f-4c60-8a6f-185fe850c24c req-f3c4da11-e61b-42ca-8da6-a6ce6834a5ba service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:44.580657 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-faa7f454-f97f-4c60-8a6f-185fe850c24c req-f3c4da11-e61b-42ca-8da6-a6ce6834a5ba service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:44.591681 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-faa7f454-f97f-4c60-8a6f-185fe850c24c req-f3c4da11-e61b-42ca-8da6-a6ce6834a5ba service nova] Creating event network-changed:8e2d5f4b-1acd-48bb-94e3-462529ef1bbb for instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 on hv-cinder-81757 Nov 19 15:19:44.597100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-faa7f454-f97f-4c60-8a6f-185fe850c24c req-f3c4da11-e61b-42ca-8da6-a6ce6834a5ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032401 Nov 19 15:19:44.597991 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 556/1237] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:19:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:19:44.601537 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:19:44.694671 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-0df55412-c462-4257-ae0d-64c3d660ed63 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 204 len: 0 microversion: 2.1 time: 0.133769 Nov 19 15:19:44.698819 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 682/1238] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:19:44 2021] DELETE /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:19:44.705185 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:44.705911 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:44.717689 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:44.718255 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:44.719702 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:44.720458 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:45.018615 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:45.025979 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c4c53831-17b5-46c4-ae7a-2e8b9aa9e65b tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1576 microversion: 2.1 time: 0.325432 Nov 19 15:19:45.026685 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 557/1239] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:44 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1576 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:46.045139 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:46.045788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:46.052604 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:46.053088 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:46.053904 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:46.054344 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:46.244759 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:46.252321 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-dadc43a1-b47d-4292-bd96-4c20a34b5d55 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1458 microversion: 2.1 time: 0.211357 Nov 19 15:19:46.252899 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 683/1240] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:46 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1458 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:47.010743 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-6512b465-54d6-4e7d-9b26-e96689abd213 req-7eef8c90-0841-4599-8e1a-1458c01ff9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fba89b-1045-4d8d-8177-e2a2f04c8bd4", "name": "network-vif-deleted", "tag": "8e2d5f4b-1acd-48bb-94e3-462529ef1bbb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:19:47.012460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:19:47.012460 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:19:47.020579 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6512b465-54d6-4e7d-9b26-e96689abd213 req-7eef8c90-0841-4599-8e1a-1458c01ff9dd service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:47.021117 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6512b465-54d6-4e7d-9b26-e96689abd213 req-7eef8c90-0841-4599-8e1a-1458c01ff9dd service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:47.035503 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-6512b465-54d6-4e7d-9b26-e96689abd213 req-7eef8c90-0841-4599-8e1a-1458c01ff9dd service nova] Creating event network-vif-deleted:8e2d5f4b-1acd-48bb-94e3-462529ef1bbb for instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 on hv-cinder-81757 Nov 19 15:19:47.040399 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-6512b465-54d6-4e7d-9b26-e96689abd213 req-7eef8c90-0841-4599-8e1a-1458c01ff9dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 Nov 19 15:19:47.041031 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 558/1241] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 15:19:47.270658 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:47.271233 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:47.277876 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:47.278332 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:47.279127 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:47.280010 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:47.355046 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:47.364714 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-8b23d2d6-ce01-41f1-9f8c-64e2ddc2ed53 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 200 len: 1225 microversion: 2.1 time: 0.099548 Nov 19 15:19:47.365405 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 684/1242] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:47 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:48.382390 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:48.383100 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 71fba89b-1045-4d8d-8177-e2a2f04c8bd4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:48.389121 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:48.389569 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:48.390864 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:48.391377 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:48.403913 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] HTTP exception thrown: Instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 could not be found. Nov 19 15:19:48.404485 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Returning 404 to user: Instance 71fba89b-1045-4d8d-8177-e2a2f04c8bd4 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:19:48.405315 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-36929dde-a1d8-4acb-9aec-49353f47d4bd tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4" status: 404 len: 111 microversion: 2.1 time: 0.027437 Nov 19 15:19:48.405828 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 559/1243] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:48 2021] GET /compute/v2.1/servers/71fba89b-1045-4d8d-8177-e2a2f04c8bd4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 15:19:51.435715 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:51.436245 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:51.443621 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:51.444030 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-1301b255-3ee3-45c3-8dd6-bf86765ca12e req-483201d9-11e8-45b1-9104-95ec36a52e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf3eece-d64c-4bf3-83bf-563ec88864ba", "tag": "955c8b76-5a6a-4692-b466-8c89094073a7"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:19:51.444560 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:51.444907 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:51.445563 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:51.445919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:19:51.445919 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:19:51.453136 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-1301b255-3ee3-45c3-8dd6-bf86765ca12e req-483201d9-11e8-45b1-9104-95ec36a52e57 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:51.453583 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-1301b255-3ee3-45c3-8dd6-bf86765ca12e req-483201d9-11e8-45b1-9104-95ec36a52e57 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:51.465799 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-1301b255-3ee3-45c3-8dd6-bf86765ca12e req-483201d9-11e8-45b1-9104-95ec36a52e57 service nova] Creating event network-changed:955c8b76-5a6a-4692-b466-8c89094073a7 for instance eaf3eece-d64c-4bf3-83bf-563ec88864ba on hv-cinder-81757 Nov 19 15:19:51.471002 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-1301b255-3ee3-45c3-8dd6-bf86765ca12e req-483201d9-11e8-45b1-9104-95ec36a52e57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030510 Nov 19 15:19:51.471602 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 560/1244] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:19:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:19:51.476481 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Going to try to terminate instance {{(pid=116265) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 15:19:51.556643 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-14e62f24-3d8c-4a46-8f61-960f2518b907 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 204 len: 0 microversion: 2.1 time: 0.124501 Nov 19 15:19:51.557462 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 685/1245] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:19:51 2021] DELETE /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 15:19:51.567595 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:51.568894 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:51.575661 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:51.576113 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:51.577129 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:51.577576 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:51.804122 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:51.811896 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b91e824-6783-41ed-b136-d2971b06d6b9 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1577 microversion: 2.1 time: 0.249791 Nov 19 15:19:51.812470 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 561/1246] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:51 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:52.830119 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:52.830818 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:52.837051 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:52.837502 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:52.838314 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:52.838749 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:53.180924 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:53.188028 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-10e151d3-e56c-4fb7-a5dc-cdb7478887cf tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1458 microversion: 2.1 time: 0.362425 Nov 19 15:19:53.188708 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 686/1247] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:52 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1458 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:54.006777 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-6b5d3d3d-f0aa-408d-91d0-a9a14bb3168f req-da2f1a5a-a730-4f8f-968e-dc7086417f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf3eece-d64c-4bf3-83bf-563ec88864ba", "name": "network-vif-deleted", "tag": "955c8b76-5a6a-4692-b466-8c89094073a7"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 15:19:54.008338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 15:19:54.008338 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 19 15:19:54.017590 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6b5d3d3d-f0aa-408d-91d0-a9a14bb3168f req-da2f1a5a-a730-4f8f-968e-dc7086417f13 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:54.018032 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-6b5d3d3d-f0aa-408d-91d0-a9a14bb3168f req-da2f1a5a-a730-4f8f-968e-dc7086417f13 service nova] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:54.029414 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-6b5d3d3d-f0aa-408d-91d0-a9a14bb3168f req-da2f1a5a-a730-4f8f-968e-dc7086417f13 service nova] Creating event network-vif-deleted:955c8b76-5a6a-4692-b466-8c89094073a7 for instance eaf3eece-d64c-4bf3-83bf-563ec88864ba on hv-cinder-81757 Nov 19 15:19:54.034870 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-6b5d3d3d-f0aa-408d-91d0-a9a14bb3168f req-da2f1a5a-a730-4f8f-968e-dc7086417f13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Nov 19 15:19:54.035736 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 562/1248] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Nov 19 15:19:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 15:19:54.205029 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:54.205634 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:54.211788 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:54.212235 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:54.213044 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:54.213486 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:54.276863 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.policy [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5389b112cc643f580e70c1b8cfe5907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65503588761e4489b784b977e0d1e639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116265) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 15:19:54.284522 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-4e868d8e-755c-4992-8aa7-8be68687174d tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 200 len: 1224 microversion: 2.1 time: 0.083270 Nov 19 15:19:54.284991 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 687/1249] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:54 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 15:19:55.301977 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:55.302671 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: eaf3eece-d64c-4bf3-83bf-563ec88864ba] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:55.308643 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.309120 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.309906 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.310342 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.323986 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] HTTP exception thrown: Instance eaf3eece-d64c-4bf3-83bf-563ec88864ba could not be found. Nov 19 15:19:55.324569 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Returning 404 to user: Instance eaf3eece-d64c-4bf3-83bf-563ec88864ba could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:19:55.325418 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b19067fb-1bf3-46fc-aa4d-b794a43b04b8 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba" status: 404 len: 111 microversion: 2.1 time: 0.027977 Nov 19 15:19:55.325935 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 563/1250] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:55 2021] GET /compute/v2.1/servers/eaf3eece-d64c-4bf3-83bf-563ec88864ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:19:55.761121 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:55.761628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.compute.api [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116265) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:55.768272 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.768716 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.769511 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.769974 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG oslo_concurrency.lockutils [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.782628 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.wsgi [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] HTTP exception thrown: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. Nov 19 15:19:55.783195 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Returning 404 to user: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. {{(pid=116265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:19:55.783994 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-f9c05b9b-9e2d-4a91-9a17-b96ac4b14a50 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 404 len: 111 microversion: 2.1 time: 0.029158 Nov 19 15:19:55.784509 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 688/1251] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Nov 19 15:19:55 2021] DELETE /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:19:55.792234 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:55.792859 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] [instance: 4f534c90-09f2-4218-b7b4-705333509372] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 15:19:55.799183 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.799629 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.800398 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 15:19:55.800847 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Lock "6acf99c9-426c-44c7-b4c6-6e0a659ed6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 15:19:55.814306 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] HTTP exception thrown: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. Nov 19 15:19:55.814883 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Returning 404 to user: Instance 4f534c90-09f2-4218-b7b4-705333509372 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 15:19:55.815677 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c0fb205-bd3e-4b77-9cfb-a761c39f111c tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372" status: 404 len: 111 microversion: 2.1 time: 0.027051 Nov 19 15:19:55.816187 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 564/1252] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Nov 19 15:19:55 2021] GET /compute/v2.1/servers/4f534c90-09f2-4218-b7b4-705333509372 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 15:19:57.085194 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: DEBUG nova.api.openstack.wsgi [None req-006f4c8f-7617-4405-b1fd-8f45ac8ac833 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] Calling method '.version_select at 0x7f37c75fd5e0>' {{(pid=116265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 15:19:57.106990 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO nova.api.openstack.requestlog [None req-006f4c8f-7617-4405-b1fd-8f45ac8ac833 tempest-TestVolumeBootPattern-232612297 tempest-TestVolumeBootPattern-232612297-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-940794978" status: 202 len: 0 microversion: 2.1 time: 0.025376 Nov 19 15:19:57.107831 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: [pid: 116265|app: 0|req: 689/1253] 10.222.0.20 () {58 vars in 1259 bytes} [Fri Nov 19 15:19:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-940794978 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 15:20:39.899513 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:20:39.900126 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:20:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:20:48.183635 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:20:48.184278 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:20:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:22:19.205455 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:22:19.206067 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:22:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:22:35.739787 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:22:35.740667 dv-cinder-817573-1-iscsi devstack@n-api.service[116265]: Fri Nov 19 15:22:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:23:06.683323 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:23:06.683964 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:23:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:23:59.917823 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:23:59.918464 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:23:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 15:24:08.200492 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 15:24:08.201425 dv-cinder-817573-1-iscsi devstack@n-api.service[116266]: Fri Nov 19 15:24:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!